/_blog/posts/70.md

---
layout: blog
week: 70
published: 2016-08-28 23:08:50
---

What happened in the [Reproducible
Builds](https://wiki.debian.org/ReproducibleBuilds) effort between Sunday August 21 and Saturday August 27 2016:

GSoC and Outreachy updates
--------------------------

- [Satyam Zode's final report for GSOC 2016](https://satyamz.github.io/blog/2016/08/22/google-summer-of-code-2016-final-report/)

Packages reviewed and fixed, and bugs filed
-------------------------------------------

* [#834976](https://bugs.debian.org/834976) filed against [auto-apt-proxy](https://tracker.debian.org/pkg/auto-apt-proxy) by Chris Lamb.
* [#835637](https://bugs.debian.org/835637) filed against [myghty](https://tracker.debian.org/pkg/myghty) by Chris Lamb.
* [#835061](https://bugs.debian.org/835061) filed against [varnish](https://tracker.debian.org/pkg/varnish) by Chris Lamb.
* [#835633](https://bugs.debian.org/835633) filed against [pleiades](https://tracker.debian.org/pkg/pleiades) by Chris Lamb.
* [#835625](https://bugs.debian.org/835625) filed against [nikwi](https://tracker.debian.org/pkg/nikwi) by Chris Lamb.
* [#835263](https://bugs.debian.org/835263) filed against [binutils-m68hc1x](https://tracker.debian.org/pkg/binutils-m68hc1x) by Chris Lamb.
* [#835448](https://bugs.debian.org/835448) filed against [eekboek](https://tracker.debian.org/pkg/eekboek) by Chris Lamb.
* [#835143](https://bugs.debian.org/835143) filed against [ttf-tiresias](https://tracker.debian.org/pkg/ttf-tiresias) by Chris Lamb.
* [#835637](https://bugs.debian.org/835637) filed against [myghty](https://tracker.debian.org/pkg/myghty) by Chris Lamb.
* [#835495](https://bugs.debian.org/835495) filed against [broccoli](https://tracker.debian.org/pkg/broccoli) by Chris Lamb.
* [#835129](https://bugs.debian.org/835129) filed against [dateutils](https://tracker.debian.org/pkg/dateutils) by Chris Lamb.
* [#835051](https://bugs.debian.org/835051) filed against [sheepdog](https://tracker.debian.org/pkg/sheepdog) by Chris Lamb.
* [#835145](https://bugs.debian.org/835145) filed against [udpcast](https://tracker.debian.org/pkg/udpcast) by Chris Lamb.
* [#834983](https://bugs.debian.org/834983) filed against [eyed3](https://tracker.debian.org/pkg/eyed3) by Chris Lamb.
* [#835617](https://bugs.debian.org/835617) filed against [congress](https://tracker.debian.org/pkg/congress) by Chris Lamb.
* [#835376](https://bugs.debian.org/835376) filed against [lilyterm](https://tracker.debian.org/pkg/lilyterm) by Chris Lamb.
* [#835130](https://bugs.debian.org/835130) filed against [ircd-ircu](https://tracker.debian.org/pkg/ircd-ircu) by Chris Lamb.
* [#835262](https://bugs.debian.org/835262) filed against [radare2](https://tracker.debian.org/pkg/radare2) by Chris Lamb.
* [#835193](https://bugs.debian.org/835193) filed against [phpdox](https://tracker.debian.org/pkg/phpdox) by Chris Lamb.
* [#835265](https://bugs.debian.org/835265) filed against [argyll](https://tracker.debian.org/pkg/argyll) by Chris Lamb.
* [#835259](https://bugs.debian.org/835259) filed against [quvi](https://tracker.debian.org/pkg/quvi) by Chris Lamb.
* [#835371](https://bugs.debian.org/835371) filed against [dispcalgui](https://tracker.debian.org/pkg/dispcalgui) by Chris Lamb.
* [#835147](https://bugs.debian.org/835147) filed against [javatools](https://tracker.debian.org/pkg/javatools) by Chris Lamb.
* [#834988](https://bugs.debian.org/834988) filed against [twitter-bootstrap3](https://tracker.debian.org/pkg/twitter-bootstrap3) by Chris Lamb.
* [#835463](https://bugs.debian.org/835463) filed against [fdroidserver](https://tracker.debian.org/pkg/fdroidserver) by Chris Lamb.
* [#835646](https://bugs.debian.org/835646) filed against [dh-lua](https://tracker.debian.org/pkg/dh-lua) by Chris Lamb.
* [#835447](https://bugs.debian.org/835447) filed against [libmodule-build-withxspp-perl](https://tracker.debian.org/pkg/libmodule-build-withxspp-perl) by Chris Lamb.
* [#835418](https://bugs.debian.org/835418) filed against [libfm](https://tracker.debian.org/pkg/libfm) by Chris Lamb.
* [#835143](https://bugs.debian.org/835143) filed against [ttf-tiresias](https://tracker.debian.org/pkg/ttf-tiresias) by Chris Lamb.
* [#834993](https://bugs.debian.org/834993) filed against [oss4](https://tracker.debian.org/pkg/oss4) by Reiner Herrmann.

Reviews of unreproducible packages
----------------------------------

10 package reviews have been added and 6 have been updated this week,
adding to our knowledge about [identified issues](https://tests.reproducible-builds.org/debian/index_issues.html).

A large number of issue types have been updated:

- [Add captures\_build\_path issue and some packages affected by it](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/da887e6)
- [Add golang\_compiler\_captures\_build\_path\_in\_binary and move obfs4proxy to it](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/9b63b1c)
- [Move 7 golang packages from captures\_build\_path to golang\_compiler\_captures\_build\_path\_in\_binary](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/5c252fb)
- Add new:
  - [random\_order\_in\_lua\_version\_substvar](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/009d350)
  - [href\_links\_mangled\_by\_node\_marked](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/89e713b)
  - [perl\_extutils\_xspp\_captures\_build\_path](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/ddcb301)
  - [timestamp\_added\_by\_java\_util\_properties](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/c8b1958)
- Fixes for issues created:
  - [perl\_extutils\_xspp\_captures\_build\_path](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/e1e3734)
  - [random\_order\_in\_lua\_version\_substvar](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/85545f4)
  - [random\_order\_in\_javahelper\_substvars](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/22c4d82)
- [Patch for zope\_random\_field\_order\_in\_dzproduct uploaded.](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/3595735)
- Rename:
  - [use\_epydoc → randomness\_in\_documentation\_generated\_by\_epydoc so it at least matches the others](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/dae53f2)
  - [random\_order\_in\_javahelper\_depends issue to random\_order\_in\_javahelper\_substvars](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/1326144)
- [Fix the link for the golang issue, previous link is for random\_build\_path\_by\_golang\_compiler a *different* issue](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/f79559b)
- [Add a tip regarding how to call ./configure for rust](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/6a1b785)
- [Add offending source line for gcc-defaults.](https://salsa.debian.org/reproducible-builds/reproducible-notes/commit/c6e7fc8)

Weekly QA work
--------------

29 FTBFS bugs have been reported by:

- Chris Lamb (27)
- Daniel Stender (1)
- Santiago Vila (1)


diffoscope development
----------------------


- Chris Lamb:
  - [Add tests for skip\_unless\_tool\_exists helper.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/7d8d8ea)
  - [comparators/elf.py: Specify string format arguments as logging function parameters, not using interpolation.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/0a46612)
  - presenters/html:
      - [Use html.escape over xml.sax.saxutils.escape.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/f51a5f1)
      - [Don't use unsafe cgi.escape method as its ``quote`` kwarg -- which enables escaping of quotation marks -- is False by default.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/779b646)
  - [Tidy imports in Debian comparator and tests.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/f19a9d5)
  - [Skip Haskell tests if GHC version does not match. (Closes: #835055)](https://salsa.debian.org/reproducible-builds/diffoscope/commit/c506dd2)
  - [Use `pytest.xfail` over `assert False`.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/eb60f70)
  - [Use the debian\_fallback.X as the fallback for debian.DotBuildinfoFile (not debian.X).](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3be080e)
  - [Rename skip\_unless\_tool\_exists -> skip\_unless\_tools\_exist and fix logic.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/1065b64)
  - [Avoid ugly DRY violations in diffoscope.comparators.\_\_init\_\_ by dynamically importing classes via a single list.](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3524aca)
- Satyam Zode:
  - [Improve diffoscope behaviour for .changes](https://salsa.debian.org/reproducible-builds/diffoscope/commit/c61f41c)
- Mattia Rizzolo:
  - [Be even more verbose about failing tests](https://salsa.debian.org/reproducible-builds/diffoscope/commit/284b0a4)
  - [d/control: alternate build-dependency on default-jdk-headless|default-jdk, to ease backporting to older debian releases](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3acdddb)
  - [add default-jdk to the alternate packages for javap for Debian; default-jdk-headless is not available in older Debian releases](https://salsa.debian.org/reproducible-builds/diffoscope/commit/2a09be4)
  - [in the tests only, normalize xxd's output so that we can compare jessie's xxd with stretch's](https://salsa.debian.org/reproducible-builds/diffoscope/commit/7e565fe)
  - tests:
      - [skip test\_squashfs.py.test\_superblock if squashfs is too old](https://salsa.debian.org/reproducible-builds/diffoscope/commit/156e891)
      - [rewrite tool\_older\_than() into skip\_unless\_tool\_is\_older\_than()](https://salsa.debian.org/reproducible-builds/diffoscope/commit/cf4a4c3)
      - [factor out a tools\_missing() function](https://salsa.debian.org/reproducible-builds/diffoscope/commit/3b98ffe)
- Jérémy Bobbio:
  - [Properly skip test requiring python-debian when unavailable](https://salsa.debian.org/reproducible-builds/diffoscope/commit/b695849)
- Ximin Luo:
  - [Add a --no-max flag to disable all limits and have max\_report\_size also honour 0 to mean "no limit"](https://salsa.debian.org/reproducible-builds/diffoscope/commit/a095c62)
  - [Actually only scan whole file when filename ends in ".rom"](https://salsa.debian.org/reproducible-builds/diffoscope/commit/6e8c271)
  - [Show the timestamp when logging so I know which steps take longer](https://salsa.debian.org/reproducible-builds/diffoscope/commit/d396eb3)

Holger also created another test job for diffoscope on jenkins.debian.net, so that now also all commits to branches other than master are being tested.

strip-nondeterminism development
--------------------------------

strip-nondeterminism `0.023-1` was uploaded by Chris Lamb:

     * Support Android .apk files with the JAR normalizer.
     * handlers/png.pm: Drop unused Archive::Zip import
     * Remove hyphen from non-determinism and non-deterministic.
     * javaproperties.pm: Match more styles of .properties and loosen filename matching.
     * Improve tests:
       - Make fixture runner generic to all normalizer types.
       - Replace (single) pearregistry test with a fixture.
       - Set a canonical time for fixture tests.
       - Add gzip testcase fixture.
       - Replace t/javadoc.t with fixture
       - Replace t/ar.t with a fixture.
       - t/javaproperties: move pom.properties and version.properties tests to fixtures
       - t/fixtures.t: move to using subtests
       - t/fixtures.t: Explicitly test that we can find a normalizer
       - t/fixtures.t: Don't run normalizer if we didn't find one.

strip-nondeterminism `0.023-2` uploaded by Mattia Rizzolo to allow stderr in autopkgtest.

disorderfs development
----------------------

- Chris Lamb:
  - [Add --sort-dirents=yes|no option for forcing deterministic.](https://salsa.debian.org/reproducible-builds/disorderfs.git/commit/?id=2aae325)
  - Testsuite:
     - [Add tests for sorting and reversing directory entries.](https://salsa.debian.org/reproducible-builds/disorderfs.git/commit/?id=647b7d6)
     - [shuffle: Test that --shuffle-dirents works as directed.](https://salsa.debian.org/reproducible-builds/disorderfs.git/commit/?id=f124965)
     - [common: Factor out utility to get variations from mount target.](https://salsa.debian.org/reproducible-builds/disorderfs.git/commit/?id=5bb2bbe)
     - [common: Factor out "Fail" utility.](https://salsa.debian.org/reproducible-builds/disorderfs.git/commit/?id=7a649d9)


tests.reproducible-builds.org
-----------------------

Debian: 

 - Since we introduced [build path variations for unstable and experimental](https://reproducible.alioth.debian.org/blog/posts/69/) last week, our IRC channel has been flooded with notifications about packages becoming unreproducible - and [you might have noticed some of your packages having become unreproducible](https://tests.reproducible-builds.org/debian/issues/unstable/captures_build_path_issue.html) recently too. To make our IRC more bearable again, notifications for status changes on i386 and armhf have been disabled, so that now we only get notifications for status changes in unstable. (h01ger)
 - Link to jenkins documentation in every page (h01ger)
 - The "pre build" check, whether a node is up, now also detects if a node has a read-only filesystem, which sometimes happens on some broken armhf nodes. (h01ger)
 - To further improve monitoring of those armhf nodes Work to make them send mails (through an ISP which is blocking outgoing mails) has been started and should be finished next week. (h01ger)
 - As one of the armhf nodes (opi2a) is acting strange, a workaround has been added to make it's deployment work despite that. (h01ger)
 - Collapse whitespace to avoid ugly "trailing underlines" in hyperlinks for diffoscope results and pkg sets (Chris Lamb)
 - Give details HTML elements "cursor: pointer" CSS property to highlight they are clickable. (Chris Lamb)
 - The db connection timeout has been raised to a minute when using SQLAlchemy too. (h01ger).

Somewhat related to reproducible builds there has been a [first Debian jenkins team maintenance meeting](http://meetbot.debian.net/debian-qa/2016/debian-qa.2016-08-24-18.00.html) on the `#debian-qa` IRC channel, to discuss current issues with the setup and to start the work of migrating jenkins.debian.net to jenkins.debian.org. The next meeting will take place on September 28th 2016 at 19 UTC.


Misc.
-----

This week's edition was written by Chris Lamb and Holger Levsen and reviewed by a bunch of Reproducible Builds folks on IRC.