Message boards : Number crunching : Amicable Numbers has slowed down
Author | Message |
---|---|
Allen Paschke Send message Joined: 27 Jan 18 Posts: 23 Credit: 13,556,172 RAC: 41,573 |
I am running Amicable Numbers on 3 different computers, all with Microsoft Windows 10 Professional x64, in CPU Mode with 3 CPUs selected. Each computer has 4 Intel i5 processors. Historically, each task would take 10 - 12 hours to complete. Starting a week or two ago, each task started taking 20+ hours to complete. I did upgrade from BOINC 7.12.1 to BOINC 7.14.1, but I've made no other software changes to any of the 3 PCs. This seems suspicious that all 3 computers would run Amicable Numbers slower. - Have other people has similar experiences? - Have there been any changes to Amicable Numbers? - Are there any parameters which I can control, so Amicable numbers will run faster. |
Brent Send message Joined: 6 Apr 18 Posts: 12 Credit: 20,200,952 RAC: 0 |
Same here. I am running Amicable Numbers CPU mode with 7 CPUs selected. This is on a Dell XPS 8900 PC with INTEL Core i7-6700 @ 3.40GHz, Windows 10 Home on 1 PC. I was processing 13-15 units a day but am now down to 7-10 per day. The main change was a recent upgrade to the latest Boinc software, but the slowdown started before this upgrade. |
Brent Send message Joined: 6 Apr 18 Posts: 12 Credit: 20,200,952 RAC: 0 |
I should add, the slowdown began around 10/20/2018 |
Allen Paschke Send message Joined: 27 Jan 18 Posts: 23 Credit: 13,556,172 RAC: 41,573 |
I agree with you, 20 October 2018 sounds about right. Yes, it was before BOINC 7.14.2. |
bryan Send message Joined: 7 Nov 17 Posts: 14 Credit: 87,038,417 RAC: 0 |
The applications were last published in September https://sech.me/boinc/Amicable/apps.php You can see how long they are recorded to take at Tasks here https://sech.me/boinc/Amicable/home.php , and then see if there is an increase. The only thing I've noticed is the number of new discoveries has for me, been non-existent for a time- explained in another thread. |
Sergei Chernykh Project administrator Project developer Send message Joined: 5 Jan 17 Posts: 534 Credit: 72,451,573 RAC: 0 |
My only guess is as numbers grow larger, internal buffers don't fit in CPU cache anymore. Hence the slowdown. |
bryan Send message Joined: 7 Nov 17 Posts: 14 Credit: 87,038,417 RAC: 0 |
Oh, if that bottleneck may be happening in primesieve the new versions has some more tweaks for that - (although last time they didn't have a noticeable impact) https://github.com/kimwalisch/primesieve/blob/master/ChangeLog Specifically 7.1: primesieve-7.1 runs up to 30% faster on Intel Skylake-X CPUs! The default sieve size is now (L2 cache size / 2). Using a sieve size that is slightly smaller than the L2 cache size reduces the number of L2 cache misses which improves performance on CPUs with slow L3 caches. primesieve-7.1 will also run slightly faster (< 3%) on most other Intel CPUs. Aside: is primesive used on OpenCL? I see that hasn't been updated on that branch for some time. |
Sergei Chernykh Project administrator Project developer Send message Joined: 5 Jan 17 Posts: 534 Credit: 72,451,573 RAC: 0 |
Oh my... I guess I'll need to update primesieve in all versions soon. This month probably because it's also used in OpenCL versions and will become a bottleneck as numbers grow larger. |
Brent Send message Joined: 6 Apr 18 Posts: 12 Credit: 20,200,952 RAC: 0 |
Gee! If the numbers growing larger is causing the slowdown, way aren't the credits also growing larger. If it is taking twice as long to process a unit, shouldn't the credits be twice as much? |
Sergei Chernykh Project administrator Project developer Send message Joined: 5 Jan 17 Posts: 534 Credit: 72,451,573 RAC: 0 |
All CPU tasks should be balanced to roughly the same execution time, they were generated with primesieve performance taken into account. it's only OpenCL version that will slowdown eventually. |
ccpmc Send message Joined: 28 May 18 Posts: 1 Credit: 34,447,580 RAC: 0 |
I'm running Amicable Numbers in a machine which can only calculating about 8 hours per day. But a workunit cost more than 20 hours. So the period is too short for me to complete the workunit. I think the period for workunits should be more longer. |
Brent Send message Joined: 6 Apr 18 Posts: 12 Credit: 20,200,952 RAC: 0 |
All CPU tasks should be balanced to roughly the same execution time, they were generated with primesieve performance taken into account. it's only OpenCL version that will slowdown eventually. Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work? |
Matt Kowal Send message Joined: 12 Feb 17 Posts: 14 Credit: 177,829,581 RAC: 0 |
Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work? OpenCL tasks on this project are for GPUs. Your system (https://sech.me/boinc/Amicable/results.php?hostid=36634) is only utilizing the CPU on this project, so no changes are needed. |
Brent Send message Joined: 6 Apr 18 Posts: 12 Credit: 20,200,952 RAC: 0 |
Ok, so how do I avoid OpenCL so I am not wasting my computer time and electricity for less work? Then why am I experiencing the slowdown if only the Open CL tasks should be affected. I am spending almost the same computer time and electricity to process almost half the workunits. And others are reporting the same issue which began about Oct. 20. |
Jozef J Send message Joined: 24 Jan 17 Posts: 20 Credit: 1,193,014,322 RAC: 0 |
hi, i see some slowing down on gpu nvidia 2080Ti ,,, on same setup and all... in win10... i see about 10 sec. more per task most proably new nvidia drivers after 400.0 i have last always . now 416.94 Or increasing app diff.??' I ask you for share your experience . thank you edit: i have also always disabled HW accelr. in web browser , clean OS from "bad bugs" now i check task run time and i find some with "old good time" 85-92 second but most of all other task have now 95-110 .. Is it diff increase or nvidia..? that is big todays question..) windows 10 1803.. |
Kellen Send message Joined: 14 Nov 17 Posts: 70 Credit: 1,000,005,236 RAC: 0 |
Hi Jozef, As we approach the end of the project the CPU time for each task will continue to increase, and for that reason you will need to run more than 1 task per GPU to reach full utilization. I switched to 2 concurrent tasks on my RTX 2070 today as the GPU utilization was down to 94%. The utilization went up to 99%-100% and now I am doing two tasks every 295 seconds instead of 1 task every 153 seconds, or a 3.7% increase in throughput. I looked at your tasks and you can see that the CPU time and the Run Time for most of them are the same. This means that the Run Time is being limited by the CPU and not using the GPU completely. To run two tasks concurrently, make a file called app_config.xml (make a text file, then change the extension to .xml from .txt) in your Amicable Numbers data directory and put the following text in it; <app_config> <app> <name>amicable_10_20</name> <gpu_versions> <gpu_usage>0.5</gpu_usage> <cpu_usage>1</cpu_usage> </gpu_versions> </app> </app_config> Once that is in there, select the Options menu in BOINC and click "Read Config Files" and two units should start running at the same time. Each unit will get a full CPU core and half of the GPU. Once CPU usage becomes about 80-90% of the total run time of a task, then the GPU utilization will probably start to decrease. If that happens, then you can change the <gpu_usage> line to make more tasks run. 0.33 would be 3 tasks, 0.25 would be 4 tasks, 0.2 would be 5 tasks, etc. Just be aware that each task will use additional memory. At this time, each task is approximately 1400MB GPU memory, so 5 tasks would be 7GB. Based on the potential total performance of your GPU compared to mine, 2 tasks might not be enough to fully utilize the RTX 2080ti and you may have to run 3 to get full use. The number of required tasks will continue to increase until the end of the project. Hope this helps. Regards, Kellen |
Jozef J Send message Joined: 24 Jan 17 Posts: 20 Credit: 1,193,014,322 RAC: 0 |
i remember just few day ago was utilizing on my 2080ti about 94-96% . But now is 85% . Booth on kernel size 23 .. So is maybe time yo use kernel 24 , as we before discus, also some people with nv tesla V 100 need higher kernel.to get more from gpu.-. |
Kellen Send message Joined: 14 Nov 17 Posts: 70 Credit: 1,000,005,236 RAC: 0 |
Hi Jozef, I do not think that the kernel size will help anymore. I have not gone through all of the code in detail, however it is my understanding that the issue now is that the CPU must determine all of the prime numbers over a very large range of values and that range of values will continue to get larger towards the end of the project. Sergei would be able to confirm it, but I suspect that the only way to increase GPU utilization from now on will be to run more tasks concurrently. Running multiple tasks will solve the problem for now and Sergei may have other solutions to the low utilization, but I am not familiar enough with the code to figure out anything else. Regards, Kellen |
Jozef J Send message Joined: 24 Jan 17 Posts: 20 Credit: 1,193,014,322 RAC: 0 |
"make a text file, then change the extension to .xml from .txt" its not work in win 10 I try change but "file" always stay as "text file" and boinc manager not read this config file.. i try many times in other projects did you try changing " extension" with "open in some program".. ? but this not work can you put edited app_config.xml on some (megaupl) and share ..? |
Kellen Send message Joined: 14 Nov 17 Posts: 70 Credit: 1,000,005,236 RAC: 0 |
Hi Jozef, I am not home right now so I can't upload a file, but it sounds like the issue you are having is probably related to the file extensions being hidden and that you have a text file with ".xml" in the name, rather than having an .xml file. To fix this; in any folder window in Windows 10 click the "View" tab and make sure that the boxes for "File Name Extensions" and "Hidden Items" are checked. This will let you see the file extension so that you can change it to app_config.xml and also so that you can see the Program Data folder to get to the Amicable Numbers data directory, which should be located at C:/ProgramData/BOINC/projects/sech.me if I remember correctly. In case my instructions are poor, I found a link to show what to click on to show file extensions. http://kb.winzip.com/kb/entry/26/ Regards, Kellen |
Message boards : Number crunching : Amicable Numbers has slowed down
©2024 Sergei Chernykh