Fwd: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Fwd: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf

Gavin McDonald
Hi All,

Just wanted to make you aware of the change to 3 of your buildbot builds so have
forwarded you the commit diff below.

Basically, 3 of your long running builds tat are taking 9 or 10 hours to complete, are spending
6 or 7 hours of that time uploading tar.gz files and zips as snapshot builds. However , they are
then all being deleted the very next day and built and uploaded all over again.

This is not great use of our hardware and bandwidth. Therefore I have inserted 'onlyIfChanged=True’
into those 3 builds so they will only build (and upload and delete) when there has been a change in the
code since the last build. This makes much more sense.

Any questions, fire away, I am subscribed to this list.

Gav…

> Begin forwarded message:
>
> From: [hidden email]
> Subject: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
> Date: 17 February 2018 at 11:35:12 am AEDT
> To: [hidden email]
> Reply-To: [hidden email]
>
> Author: gmcdonald
> Date: Sat Feb 17 00:35:11 2018
> New Revision: 1025487
>
> Log:
> Changed 3 schedulers to only build when scheduled
> and only if the code has changed since the last build.
>
> Some of these builds are taking 3 hours to perform, then
> they are taking 7+ hours to upload 2.5GB worth of various
> tar.gz files -- only to delete all of it the next day and
> do it all over again!
>
> This is not good use of CI hardware or our bandwidth. So
> it makes sense to only build these at the scheduled time
> only if some part of the code has changed.
>
>
> Modified:
>    infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>
> Modified: infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
> ==============================================================================
> --- infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf (original)
> +++ infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf Sat Feb 17 00:35:11 2018
> @@ -9,14 +9,16 @@ c['schedulers'].append(Nightly(name='ope
>               builderNames=['openoffice-linux64-nightly'],
>               branch='openoffice/trunk',
>               hour=4,
> -              minute=10))
> +              minute=10,
> +              onlyIfChanged=True))
>
> c['schedulers'].append(Nightly(name='openoffice-linux64-41x',
>               builderNames=['openoffice-linux64-41x'],
>               branch='openoffice/branches/AOO415',
>               dayOfWeek=[6],
>               hour=12,
> -              minute=40))
> +              minute=40,
> +              onlyIfChanged=True))
>
> c['schedulers'].append(Nightly(name='openoffice-nightly-rat',
>               builderNames=['openoffice-nightly-rat'],
> @@ -34,14 +36,16 @@ c['schedulers'].append(Nightly(name='ope
>               builderNames=['openoffice-linux32-nightly'],
>               branch='openoffice/trunk',
>               hour=2,
> -              minute=5))
> +              minute=5,
> +              onlyIfChanged=True))
>
> c['schedulers'].append(Nightly(name='openoffice-linux32-41x',
>               builderNames=['openoffice-linux32-41x'],
>               branch='openoffice/branches/AOO415',
>               dayOfWeek=[5],
>               hour=7,
> -              minute=9))
> +              minute=9,
> +              onlyIfChanged=True))
>
> c['schedulers'].append(Nightly(name='aoo-win7-nightly',
>               builderNames=['aoo-win7'],
>

Reply | Threaded
Open this post in threaded view
|

Re: Fwd: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf

Matthias Seidel
Hi Gavin,

Am 17.02.2018 um 01:40 schrieb Gavin McDonald:

> Hi All,
>
> Just wanted to make you aware of the change to 3 of your buildbot builds so have
> forwarded you the commit diff below.
>
> Basically, 3 of your long running builds tat are taking 9 or 10 hours to complete, are spending
> 6 or 7 hours of that time uploading tar.gz files and zips as snapshot builds. However , they are
> then all being deleted the very next day and built and uploaded all over again.
>
> This is not great use of our hardware and bandwidth. Therefore I have inserted 'onlyIfChanged=True’
> into those 3 builds so they will only build (and upload and delete) when there has been a change in the
> code since the last build. This makes much more sense.
Indeed!

I was not aware of such helpful switches. There may be many more, can
you recommend a documentation for the buildbots?

What I would like to do in the near future is to unify the names of our
buildbots and make the names more generic, e.g.:

aoo-windows32-branch
aoo-windows32-trunk
aoo-linux32-branch
aoo-linux32-trunk
...

Until now I only managed to change the branch from 414 to 415.

Regards,
   Matthias

>
> Any questions, fire away, I am subscribed to this list.
>
> Gav…
>
>> Begin forwarded message:
>>
>> From: [hidden email]
>> Subject: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>> Date: 17 February 2018 at 11:35:12 am AEDT
>> To: [hidden email]
>> Reply-To: [hidden email]
>>
>> Author: gmcdonald
>> Date: Sat Feb 17 00:35:11 2018
>> New Revision: 1025487
>>
>> Log:
>> Changed 3 schedulers to only build when scheduled
>> and only if the code has changed since the last build.
>>
>> Some of these builds are taking 3 hours to perform, then
>> they are taking 7+ hours to upload 2.5GB worth of various
>> tar.gz files -- only to delete all of it the next day and
>> do it all over again!
>>
>> This is not good use of CI hardware or our bandwidth. So
>> it makes sense to only build these at the scheduled time
>> only if some part of the code has changed.
>>
>>
>> Modified:
>>    infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>
>> Modified: infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>> ==============================================================================
>> --- infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf (original)
>> +++ infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf Sat Feb 17 00:35:11 2018
>> @@ -9,14 +9,16 @@ c['schedulers'].append(Nightly(name='ope
>>               builderNames=['openoffice-linux64-nightly'],
>>               branch='openoffice/trunk',
>>               hour=4,
>> -              minute=10))
>> +              minute=10,
>> +              onlyIfChanged=True))
>>
>> c['schedulers'].append(Nightly(name='openoffice-linux64-41x',
>>               builderNames=['openoffice-linux64-41x'],
>>               branch='openoffice/branches/AOO415',
>>               dayOfWeek=[6],
>>               hour=12,
>> -              minute=40))
>> +              minute=40,
>> +              onlyIfChanged=True))
>>
>> c['schedulers'].append(Nightly(name='openoffice-nightly-rat',
>>               builderNames=['openoffice-nightly-rat'],
>> @@ -34,14 +36,16 @@ c['schedulers'].append(Nightly(name='ope
>>               builderNames=['openoffice-linux32-nightly'],
>>               branch='openoffice/trunk',
>>               hour=2,
>> -              minute=5))
>> +              minute=5,
>> +              onlyIfChanged=True))
>>
>> c['schedulers'].append(Nightly(name='openoffice-linux32-41x',
>>               builderNames=['openoffice-linux32-41x'],
>>               branch='openoffice/branches/AOO415',
>>               dayOfWeek=[5],
>>               hour=7,
>> -              minute=9))
>> +              minute=9,
>> +              onlyIfChanged=True))
>>
>> c['schedulers'].append(Nightly(name='aoo-win7-nightly',
>>               builderNames=['aoo-win7'],
>>
>


smime.p7s (5K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf

Gavin McDonald


> On 18 Feb 2018, at 2:46 am, Matthias Seidel <[hidden email]> wrote:
>
> Hi Gavin,
>
> Am 17.02.2018 um 01:40 schrieb Gavin McDonald:
>> Hi All,
>>
>> Just wanted to make you aware of the change to 3 of your buildbot builds so have
>> forwarded you the commit diff below.
>>
>> Basically, 3 of your long running builds tat are taking 9 or 10 hours to complete, are spending
>> 6 or 7 hours of that time uploading tar.gz files and zips as snapshot builds. However , they are
>> then all being deleted the very next day and built and uploaded all over again.
>>
>> This is not great use of our hardware and bandwidth. Therefore I have inserted 'onlyIfChanged=True’
>> into those 3 builds so they will only build (and upload and delete) when there has been a change in the
>> code since the last build. This makes much more sense.
>
> Indeed!
>
> I was not aware of such helpful switches. There may be many more, can
> you recommend a documentation for the buildbots?

Best page I can recommend for our installation versions is :-

http://docs.buildbot.net/0.8.9/full.html <http://docs.buildbot.net/0.8.9/full.html>


>
> What I would like to do in the near future is to unify the names of our
> buildbots and make the names more generic, e.g.:
>
> aoo-windows32-branch
> aoo-windows32-trunk
> aoo-linux32-branch
> aoo-linux32-trunk
> …

Makes sense, but please note that changing builder names loses all history for a build as it
starts again from build number 0. So if doing it, make sure its one to stick around for a while.


Gav…

>
> Until now I only managed to change the branch from 414 to 415.
>
> Regards,
>    Matthias
>
>>
>> Any questions, fire away, I am subscribed to this list.
>>
>> Gav…
>>
>>> Begin forwarded message:
>>>
>>> From: [hidden email]
>>> Subject: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>> Date: 17 February 2018 at 11:35:12 am AEDT
>>> To: [hidden email]
>>> Reply-To: [hidden email]
>>>
>>> Author: gmcdonald
>>> Date: Sat Feb 17 00:35:11 2018
>>> New Revision: 1025487
>>>
>>> Log:
>>> Changed 3 schedulers to only build when scheduled
>>> and only if the code has changed since the last build.
>>>
>>> Some of these builds are taking 3 hours to perform, then
>>> they are taking 7+ hours to upload 2.5GB worth of various
>>> tar.gz files -- only to delete all of it the next day and
>>> do it all over again!
>>>
>>> This is not good use of CI hardware or our bandwidth. So
>>> it makes sense to only build these at the scheduled time
>>> only if some part of the code has changed.
>>>
>>>
>>> Modified:
>>>   infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>>
>>> Modified: infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>> ==============================================================================
>>> --- infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf (original)
>>> +++ infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf Sat Feb 17 00:35:11 2018
>>> @@ -9,14 +9,16 @@ c['schedulers'].append(Nightly(name='ope
>>>              builderNames=['openoffice-linux64-nightly'],
>>>              branch='openoffice/trunk',
>>>              hour=4,
>>> -              minute=10))
>>> +              minute=10,
>>> +              onlyIfChanged=True))
>>>
>>> c['schedulers'].append(Nightly(name='openoffice-linux64-41x',
>>>              builderNames=['openoffice-linux64-41x'],
>>>              branch='openoffice/branches/AOO415',
>>>              dayOfWeek=[6],
>>>              hour=12,
>>> -              minute=40))
>>> +              minute=40,
>>> +              onlyIfChanged=True))
>>>
>>> c['schedulers'].append(Nightly(name='openoffice-nightly-rat',
>>>              builderNames=['openoffice-nightly-rat'],
>>> @@ -34,14 +36,16 @@ c['schedulers'].append(Nightly(name='ope
>>>              builderNames=['openoffice-linux32-nightly'],
>>>              branch='openoffice/trunk',
>>>              hour=2,
>>> -              minute=5))
>>> +              minute=5,
>>> +              onlyIfChanged=True))
>>>
>>> c['schedulers'].append(Nightly(name='openoffice-linux32-41x',
>>>              builderNames=['openoffice-linux32-41x'],
>>>              branch='openoffice/branches/AOO415',
>>>              dayOfWeek=[5],
>>>              hour=7,
>>> -              minute=9))
>>> +              minute=9,
>>> +              onlyIfChanged=True))
>>>
>>> c['schedulers'].append(Nightly(name='aoo-win7-nightly',
>>>              builderNames=['aoo-win7'],
>>>
>>
>
>

Reply | Threaded
Open this post in threaded view
|

Re: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf

Peter Kovacs-3
I have updated CWiki with the build bot documentation links.

https://cwiki.apache.org/confluence/display/OOOUSERS/Buildbot+info


On 18.02.2018 09:37, Gavin McDonald wrote:

>
>> On 18 Feb 2018, at 2:46 am, Matthias Seidel <[hidden email]> wrote:
>>
>> Hi Gavin,
>>
>> Am 17.02.2018 um 01:40 schrieb Gavin McDonald:
>>> Hi All,
>>>
>>> Just wanted to make you aware of the change to 3 of your buildbot builds so have
>>> forwarded you the commit diff below.
>>>
>>> Basically, 3 of your long running builds tat are taking 9 or 10 hours to complete, are spending
>>> 6 or 7 hours of that time uploading tar.gz files and zips as snapshot builds. However , they are
>>> then all being deleted the very next day and built and uploaded all over again.
>>>
>>> This is not great use of our hardware and bandwidth. Therefore I have inserted 'onlyIfChanged=True’
>>> into those 3 builds so they will only build (and upload and delete) when there has been a change in the
>>> code since the last build. This makes much more sense.
>> Indeed!
>>
>> I was not aware of such helpful switches. There may be many more, can
>> you recommend a documentation for the buildbots?
> Best page I can recommend for our installation versions is :-
>
> http://docs.buildbot.net/0.8.9/full.html <http://docs.buildbot.net/0.8.9/full.html>
>
>
>> What I would like to do in the near future is to unify the names of our
>> buildbots and make the names more generic, e.g.:
>>
>> aoo-windows32-branch
>> aoo-windows32-trunk
>> aoo-linux32-branch
>> aoo-linux32-trunk
>> …
> Makes sense, but please note that changing builder names loses all history for a build as it
> starts again from build number 0. So if doing it, make sure its one to stick around for a while.
>
>
> Gav…
>
>> Until now I only managed to change the branch from 414 to 415.
>>
>> Regards,
>>     Matthias
>>
>>> Any questions, fire away, I am subscribed to this list.
>>>
>>> Gav…
>>>
>>>> Begin forwarded message:
>>>>
>>>> From: [hidden email]
>>>> Subject: svn commit: r1025487 - /infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>>> Date: 17 February 2018 at 11:35:12 am AEDT
>>>> To: [hidden email]
>>>> Reply-To: [hidden email]
>>>>
>>>> Author: gmcdonald
>>>> Date: Sat Feb 17 00:35:11 2018
>>>> New Revision: 1025487
>>>>
>>>> Log:
>>>> Changed 3 schedulers to only build when scheduled
>>>> and only if the code has changed since the last build.
>>>>
>>>> Some of these builds are taking 3 hours to perform, then
>>>> they are taking 7+ hours to upload 2.5GB worth of various
>>>> tar.gz files -- only to delete all of it the next day and
>>>> do it all over again!
>>>>
>>>> This is not good use of CI hardware or our bandwidth. So
>>>> it makes sense to only build these at the scheduled time
>>>> only if some part of the code has changed.
>>>>
>>>>
>>>> Modified:
>>>>    infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>>>
>>>> Modified: infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf
>>>> ==============================================================================
>>>> --- infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf (original)
>>>> +++ infrastructure/buildbot/aegis/buildmaster/master1/projects/openofficeorg.conf Sat Feb 17 00:35:11 2018
>>>> @@ -9,14 +9,16 @@ c['schedulers'].append(Nightly(name='ope
>>>>               builderNames=['openoffice-linux64-nightly'],
>>>>               branch='openoffice/trunk',
>>>>               hour=4,
>>>> -              minute=10))
>>>> +              minute=10,
>>>> +              onlyIfChanged=True))
>>>>
>>>> c['schedulers'].append(Nightly(name='openoffice-linux64-41x',
>>>>               builderNames=['openoffice-linux64-41x'],
>>>>               branch='openoffice/branches/AOO415',
>>>>               dayOfWeek=[6],
>>>>               hour=12,
>>>> -              minute=40))
>>>> +              minute=40,
>>>> +              onlyIfChanged=True))
>>>>
>>>> c['schedulers'].append(Nightly(name='openoffice-nightly-rat',
>>>>               builderNames=['openoffice-nightly-rat'],
>>>> @@ -34,14 +36,16 @@ c['schedulers'].append(Nightly(name='ope
>>>>               builderNames=['openoffice-linux32-nightly'],
>>>>               branch='openoffice/trunk',
>>>>               hour=2,
>>>> -              minute=5))
>>>> +              minute=5,
>>>> +              onlyIfChanged=True))
>>>>
>>>> c['schedulers'].append(Nightly(name='openoffice-linux32-41x',
>>>>               builderNames=['openoffice-linux32-41x'],
>>>>               branch='openoffice/branches/AOO415',
>>>>               dayOfWeek=[5],
>>>>               hour=7,
>>>> -              minute=9))
>>>> +              minute=9,
>>>> +              onlyIfChanged=True))
>>>>
>>>> c['schedulers'].append(Nightly(name='aoo-win7-nightly',
>>>>               builderNames=['aoo-win7'],
>>>>
>>
>


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]