`buildjson`¶

This module helps with the buildjson data generated by the Release Engineering systems: http://builddata.pub.build.mozilla.org/builddata/buildjson

mozci.sources.buildjson.query_job_data(complete_at, request_id)¶

Look for a job identified by request_id inside of a buildjson file under the “builds” entry.

Through complete_at, we can determine on which day we can find the metadata about this job.

WARNING: “request_ids” and the ones from “properties” can differ. Issue filed.

If found, the returning entry will look like this (only important values are referenced):

{
    "builder_id": int, # It is a unique identifier of a builder
    "starttime": int,
    "endtime": int,
    "properties": {
        "blobber_files": json, # Mainly applicable to test jobs
        "buildername": string,
        "buildid": string,
        "log_url", string,
        "packageUrl": string, # It only applies for build jobs
        "revision": string,
        "repo_path": string, # e.g. projects/cedar
        "request_ids": list of ints, # Scheduling ID
        "slavename": string, # e.g. t-w864-ix-120
        "symbolsUrl": string, # It only applies for build jobs
        "testsUrl": string,   # It only applies for build jobs
    },
    "request_ids": list of ints, # Scheduling ID
    "requesttime": int,
    "result": int, # Job's exit code
    "slave_id": int, # Unique identifier for the machine that run it
}

NOTE: Remove this block once https://bugzilla.mozilla.org/show_bug.cgi?id=1135991 is fixed.

There is so funkiness in here. A buildjson file for a day is produced every 15 minutes all the way until midnight pacific time. After that, a new _UTC_ day commences. However, we will only contain all jobs ending within the UTC day and not the PT day. If you run any of this code in the last 4 hours of the pacific day, you will have a gap of 4 hours for which you won’t have buildjson data (between 4-8pm PT). The gap starts appearing after 8pm PT when builds-4hr cannot cover it.

If we look all endtime values on a day and we print the minimum and maximum values, this is what we get:

1424649600 Mon, 23 Feb 2015 00:00:00  () Sun, 22 Feb 2015 16:00:00 -0800 (PST)
1424736000 Tue, 24 Feb 2015 00:00:00  () Mon, 23 Feb 2015 16:00:00 -0800 (PST)

This means that since 4pm to midnight we generate the same file again and again without adding any new data.

buildjson¶

`buildjson`¶