CPDN Aktualne

Analýza, modelovanie a predpovedanie klimatických zmien na Zemi

Moderátor: Moderátori

Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Z fora projektu:
Re: News

Postby Thyme Lawn » 21 May 2011 01:52
CDPN Main Project

The availability of work is likely to be very intermittent for a few days.

Although the server status page almost always shows no tasks available the Weather@home resubmission process is running and new workunits are being generated from completed HadAM3P regional tasks. Due to the large number of hosts requesting work getting hold of a task is very much down to luck; the tasks created from the resubmission workunits are disappearing as quickly as they become available.

A number of server configuration changes are taking place to reduce the load placed on climateapps2 and no new batches of work will be released until these have been completed:

[*] another server will be assuming the role of the third download mirror server. This will free up a lot of the disk space and network bandwidth on climateapps2. During the reconfiguration process files are being transferred off of climateapps2. This might result in some users experiencing download failures; apologies if you are one of those affected.

[*]as previously mentioned, the daily credit calculation will be moved from climateapps2 to relieve it of intense CPU and database loads required for that process. It will almost certainly be moved to the backup database server. This should stop the problems with scheduler requests and BOINC forum access which can occur when the credit script is running.

[*] climateapps2 will continue to serve as the scheduler and primary database server.

teda treba len "vydržať".
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Re: News

Unread postby Thyme Lawn » 28 May 2011 01:05
CPDN Main Project

The server status page is currently showing uploader1.atm.ox.ac.uk as not running. That's where the _3, _6, _9 and _12 upload files for Weather@home (HadAM3P regional) models are sent.

uploader1 was running short of disk space yesterday and Milo took it down for a while to recover some space by moving some FAMOUS upload files to another server. He was hoping this would give sufficient leeway to allow a larger quantity of HadAM3P data to be moved while the system was accepting new uploads, but it looks like this hasn't been possible. Moving upload files between servers is never going to be a trivial process; the uploaded data is being used by researchers around the world and the integrity of the results database used to retrieve the data has to be maintained at all times.

Any completed Weather@home tasks will stay in the "Uploading" state until uploader1 is back up. Tasks in that state cannot be reported until those files have been uploaded but will already have received their full credit because that's determined from the trickles sent to the scheduler. Please do not abort any tasks stuck in this state.

Unfortunately the server reconfiguration exercise started a week ago is taking a lot longer than was anticipated. As mentioned last week, there will be no new batches of tasks until this has been completed. The recent reports of stuck downloads might be due to point #1 in the last news post.

A number of users have reported a discrepancy between the credits reported on the CPDN site and third party statistics sites. This is because the export file retrieved by third party statistics sites hasn't been updated for a couple of weeks. I'm not sure if this is intended or accidental.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

.... a este nieco z noviniek projektu:

Unread Message 42318 - Posted 4 Jun 2011 15:19:44 UTC


Last modified: 4 Jun 2011 15:21:03 UTC

CPDN Main Project

The server reconfiguration work has almost been completed but unfortunately neither Jonathan nor Andy were aware that the new download server (manticore.oerc.ox.ac.uk) would be inaccessible to users until the relevant port had been opened up on the university's firewall. All files without an application version stamp appear to be affected and they will be stuck in BOINC's transfer queue until the firewall changes have been made. This is unlikely to happen until Monday.
Používateľov profilový obrázok
Palo M.
Príspevky: 1200
Dátum registrácie: Po Feb 12, 2007 2:53 am
Bydlisko: Shanghai, China

Re: CPDN Aktualne

Príspevok od používateľa Palo M. »

Ja mam coraz silnejsi pocit, ze v CPDN projekte je to dost amaterske... a namiesto toho, aby sa to zlepsovalo, tak to ide dolu vodou. Ale pritom kedysi to tak byt nemohlo, lebo z velkych projektov ma len CPDN implementovane tricklets a to zjavne celkom dobre funguje, takze to tam kedysi niekto musel spojazdnit a asi aj odladit. Ale co tam teraz stvaraju, tak to je hodne jednochlapoveho domaceho projektu...
Ked vidim ake problemy su s projektom v IT, tak neviem-neviem, ako je to v dalsich sekciach... lebo ja tam citim celkovy chaos, nedostatok rozumneho riadenia a potom zacinam mat aj pochybnosti o vedeckej stranke projektu (v tom zmysle, ze individualni vedci mozu robit kazdy svoj diel dobre, ale bez rozumnej organizacie prace vyjde ich usilie navnivoc a vysledky potom nezodpovedaju vynalozenej praci).
Obrázok
---
Obrázok
"Ostatně, kdybych si měl vybrat pořadí Mac OS X, Windows, Linux, tak to bude: Linux, Mac OS X, sebevražda, Windows." (úryvok z internetovej diskusie)
Honza
Príspevky: 953
Dátum registrácie: Po Feb 05, 2007 7:20 pm
Bydlisko: Praha

Re: CPDN Aktualne

Príspevok od používateľa Honza »

Koukám na to teď pouze z dálky a...problémy s místem na disku jsou dlouhodobé, i před lety se data šoupala sem a tam.
Nevím jak teď, ale dříve bylo IT jako one-man-show.
Možná dnes je horší, že na projektu nejsou lidé, kteří by měli vizi, drive a vůbec tomu věnovali tolik, co když projekt začínal. Ale to je třeba jenom pocit.

Na přelomu july/august možná budu v UK a možná dokonce v Oxfordu, třeba se tam stavím jako dříve...
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

dalsie info z fora projektu:
hadcm3n is NOT compatible with CPUs/processors without SSE2 capabilities. That means HADCM3N is NOT compatible with:

Pentium 3, Pentium 3 based Celerons and Xeons, and older Intel processors, and
Athlon XP/MP, Athlon XP based Semprons/Durons, and older AMD processors.

A computer with a processor listed above downloading one of these models will result in an immediate crash. This is not expected to change in the future.

When FAMOUS is available, it is compatible with these older processors. Sorry.

a dalsie:
Towards the end of last year the project gradually lost it's two programmers and the project leader for the Millennium model. New staff didn't arrive until February this year, since when they're been learning about the project, and fixing all of the server problems, as well as trying to get new work running.

The new work for the second phase of the new RAPID/RAPIT model (description), is proving to be tricky, and only a few dozen models at a time are being released.

You can read all about these matters in the News and Announcements thread.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Firewall Maintenance 28 June 2011

I have just received notification that the firewall that sits between the project servers and the rest of the world is scheduled for maintenance on 28 June 2011 between 0700 and 0900 BST.

This means that it is highly likely that connectivity to the project will be lost during this period.

Jonathan
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Laduju sa jednotky regionalneho modelu pre Europu, momentalne nieco vyse 1000


... a uz je ich iba 5
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

WU RAPID-RAPIT HadCM3N Tasks ready to send 2,193
a dufam, ze uz nebudu padat po niekolkych hodinach z dovodu extremnych hodnot parametrov
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

z fora projektu:
The next phase of the RAPIT/RAPID models are now being auto-generated from the completed models from the first phase.

Note 1: They're being grabbed as soon as they appear, and the one hour back off still applies to prevent a few computers from hogging all of the work.
Note 2: Attempts to use the Update button to speed things up will have the opposite effect - the timer will be reset to 1 hour (+/-), and you'll be back to square one.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

cerstva novinka:

CPDN Main Project
After a number of false starts with faulty greenhouse gas (GHG) forcing parameters the second phase of the RAPIT project has now started in earnest.
HadCM3N tasks have names in the format hadcm3n_{umid}_{start year}_40_* (where 40 is the number of model years the task runs for).
{umid} is a 4 character universal model identity, with the first character being the main indicator of the type of model being run as follows:
'o', 'p' and 'q' are control models with no GHG forcing. These should continue through the resubmission processes at 1940 and 1980 (and beyond if the scientists decide that's required) with no problems.
at the first resubmission (hadcm3n_{umid}_1940_40_*) each successful control should, in addition, spawn a new series of workunits with a range of GHG forcing parameters. This has been the problem area, with the first character of the {umid} set as follows:
'r' - a large batch of workunits which all fail at the end of the first model year before a trickle is generated. Most of these have been completed but if you have a task with the name format hadcm3n_rXXX_1940_40_ it should be aborted.
's' - another large batch, this time failing at the end of the 10th model year, just before the trickle and upload file are generated. If you have a task with the name format hadcm3n_sXXX_1940_40_ it should be aborted. The workunits for these tasks have been cancelled on the server to prevent reissues.
'b' to 'i' - small test batches which will fail at the end of the first or 10th model year. These should be aborted.
'j' - a small test batch with GHG forcing brought forward from 1950 to 1941. These tasks should complete as long as the climate doesn't go wild.
'k' - a small stress test batch with highly variable GHG forcing. These tasks should also complete as long as the climate doesn't go wild.
't' - this is the large batch of work currently being generated from the 'o' series controls which have completed the first phase. Tasks with the name format hadcm3n_tXXX_1940_40_ should complete as long as the climate doesn't go wild.

A small number of hadcm3n_tXXX_1980_40_ workunits have been generated from 'o' series tasks which have already completed the second phase. This shouldn't have happened (the _tXXX_1980_ batch should be a continuation of the _tXXX_1940_ batch). These have been cancelled on the server to prevent reissues and should be aborted.

NOTE: tasks with the name format hadcm3n_tXXX_1980_40_ will start appearing again in 2 or 3 weeks and will be from genuine resubmission workunits. These should not be aborted.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Staršie počítače majú momentálne pauzu v tomto projekte, pretože:
hadcm3n is NOT compatible with CPUs/processors without SSE2 capabilities. That means HADCM3N is NOT compatible with

Pentium 3, Pentium 3 based Celerons and Xeons, and older Intel processors, and
Athlon XP/MP, Athlon XP based Semprons/Durons, and older AMD processors.

A computer with a processor listed above downloading one of these models will result in an immediate crash. This is not expected to change in the future.

When FAMOUS is available, it is compatible with these older processors. Sorry.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Nedavne dlhotrvajuce problemy v projekte sa podpisali aj na nasom time.
Prevodom aktivit niektorych clenov na ine projekty sme v sucasnej dobe poklesli s RAC az na 32 miesto.
Neagitujem (ale neskodilo by), iba informujem.
Projekt uz viac ako dva tyzdne funguje, tak ako sme boli zvyknuti predtym.
Kedze aktualne jednotky su zalozene pre regionalne projekty a ocean:
UK Met Office HADAM3P European Region v6.09
UK Met Office Coupled Model Full Resolution Ocean v6.07.
Starsie kompy si budu musiet este pockat nez budu jednotky pre SlabModel a Famous. (vid moj predchadzajuci prispevok s info prebratou z fora projektu.)

Pre ine modely jednotky v dohladnej dobe nebudu.
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

Momentalne su vsetky WU rozobrate :(
Používateľov profilový obrázok
marpes
Príspevky: 455
Dátum registrácie: Po Feb 05, 2007 7:18 pm
Bydlisko: Bratislava
Kontaktovať používateľa:

Re: CPDN Aktualne

Príspevok od používateľa marpes »

... a opat nieco z fora projektu:
There is work available, but the generation of hadam3p models is happening very slowly, and they are being grabbed instantly by the 10s of thousands of computers wanting work.
Napísať odpoveď