Message boards : Number crunching : Credit system seems unfair, anyone else thinks so?
Author | Message |
---|---|
TheRiceKing Send message Joined: 23 Apr 07 Posts: 2 Credit: 619,489 RAC: 0 |
Credit system seems unfair, anyone else thinks so? |
Daniel Kohn Send message Joined: 30 Dec 05 Posts: 18 Credit: 2,899,939 RAC: 0 |
Credit system seems unfair, anyone else thinks so? No, I think it's fair enough. As long as I can get a sense of how much work I've completed, that's enough for me. I just wish I could get my company to join up. |
Mikkie Send message Joined: 26 Nov 07 Posts: 2 Credit: 2,770 RAC: 0 |
Credit system seems unfair, anyone else thinks so?Explain why! |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,821,902 RAC: 15,180 |
i think it's almost as fair as it can get. There are fluctuations, but they're generally quite minor. |
[KWSN]John Galt 007 Send message Joined: 4 Aug 06 Posts: 6 Credit: 1,017,647 RAC: 0 |
I think what the original poster is getting at is what I am experiencing: 123448301 112219447 27 Nov 2007 22:23:45 UTC 1 Dec 2007 15:40:33 UTC Over Success Done 86,143.66 251.36 139.76 The difference between cliamed and granted is about 44%. It seems that all of my results end up with a lower granted than claimed. Is this due to the BOINC CC or the Rosetta app? |
Luuklag Send message Joined: 13 Sep 07 Posts: 262 Credit: 4,171 RAC: 0 |
I think what the original poster is getting at is what I am experiencing: it has to do with the comparrison to other machines that finished sort like WU's. the claimed credit is based on the speed of your machine and the time crunched. the granted credit is based on "things" dont have a word for it at this moment, produced, so data the scientists can work with, that explains the differece, if you work for 4 hours but produce crap, they dont think your'e worth much credit. |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Credit is issued per completed model. Regardless of the beauty or lack thereof in the model produced. The rate of credit granted per model is dynamically adjusted as results from comparable tasks come in. Rosetta Moderator: Mod.Sense |
David Emigh Send message Joined: 13 Mar 06 Posts: 158 Credit: 417,178 RAC: 0 |
I want to make it clear at the outset that I personally don't crunch for credit. I know some do, however, and I respect that also. In the interest of providing data to satisfy curiosity, I looked through my task history and found this one for which I was granted more credit than claimed. Rosie, Rosie, she's our gal, If she can't do it, no one shall! |
Luuklag Send message Joined: 13 Sep 07 Posts: 262 Credit: 4,171 RAC: 0 |
I want to make it clear at the outset that I personally don't crunch for credit. I know some do, however, and I respect that also. well thats because you made an large number of decoys.. you should try to devide credit givven by the number of decoys and credit claimed by the cpu time runned and something to do with memory and processor speed etc.. that should give you some data to compare better. |
dcdc Send message Joined: 3 Nov 05 Posts: 1832 Credit: 119,821,902 RAC: 15,180 |
I want to make it clear at the outset that I personally don't crunch for credit. I know some do, however, and I respect that also. It's fairly straight forward: claimed credit is your benchmark * time granted credit is the average claim per decoy (model) from all submissions so far for that WU * number of decoys produced. |
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
It's been a while since I looked at the formula for credit. Claimed Credit is based upon the official boinc formula which uses the Benchmarks. It is ((whetstone + dhrystone) X CPU seconds)/1,728,000= claimed credit/task. Rosetta divides this by the number of decoys completed. This number is then "claimed credits/decoy". Each time decoys are returned Rosetta adds this value to the previous returned value and divides this by the total number now returned. This is the (current) average credit granted/decoy. It then looks at the task returned, multiplies the number of completed decoys by the "current" claimed credit/decoy and issues this amount which is called "granted credit/task". Since claimed credit is based upon the benchmark, and different computers take diffferent amounts of time to complete, claimed credit/time varies. I have received questions about "optimized third party boinc core clients", these generally claim as much as 3 times what the stock one does, and since normal variation is generally less than the 3X provided by these clients. I compiled the following chart using a value of 3 as the "average claimed credit/decoy", then then 9 for that of the third party boinc core clients. Last I knew many WUs(tasks) contained ~100K decoys (with some variations). So what the chart shows is what happens to "granted credit/decoy" with 3 different scenarios. Two with a 10% and one with a 20% penetration rate for third party boinc CC's. (see legend). You can see the deviation in Granted Credit/decoy after the return of 100, 1000, and 5,000 decoys (of the 100K) available. One can see that within very few (relative) returns, that variations in claims make little difference. |
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
My AMD64 2800 has been connected to Rosetta on/off for a while. Below is a chart of the periods data was collected, and the "average" granted credit/hour for the listed period. As you can see, there's not been much variation. Note: the first collection period was for work done prior to Rosetta's new credit method being implemented. |
Greg_BE Send message Joined: 30 May 06 Posts: 5691 Credit: 5,859,226 RAC: 0 |
My AMD64 2800 has been connected to Rosetta on/off for a while. Below is a chart of the periods data was collected, and the "average" granted credit/hour for the listed period. As you can see, there's not been much variation. Note: the first collection period was for work done prior to Rosetta's new credit method being implemented. never charted my machine, but i think you and i have similar amd cpus, but your stepping is a bit higher than mine. whatever that means. |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Hey Astro! Last you knew, there were 100,000+ "STEPS" in a decoy (or model). But a task generally runs 1-100 models in 1-24hrs. So, I'm not sure what your chart is meant to show, but with a 100,000 decoys premise, it is most definately flawed. Rosetta Moderator: Mod.Sense |
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
Hey Astro! Correct me oh wise one?? I was under that impression that a task such as "gb3_DC_BOINC_MFR_ABRELAX_PICKED" contained 100K models/decoys (models and decoys the same thing), and that each distributed task merely started searching at different point within the wu. So, if it contained 100K models(varying of course), and I did 10 of them, then I did .01% of the wu(task). Correct me and I'll reword/rework it. For example, for this wu :gb3_DC_BOINC_MFR_ABRELAX_PICKED_2342_11052_0 I did 20 decoys. 20 out of ? many? Hmm, perhaps I'm confusing "model" with "decoy"?? My data show a granting of 3 credits/ "decoy", then the occasional influx of a 9 from third party clients. the chart was calculated based upon 3 credits/decoy. So, If I did a wu and completed ONE decoy, I'd claim 3 credits. IF I were the first to report a decoy of that task (or whatever the proper name is), then Rosetta would look at my claim of 3, divide it by the number of decoys reported (since mine was first that number would be 1), so 3/1=granted credit of 3/decoy X 1 decoy = granted credit of 3. Then someone else using a stock CC would return on and return ONE decoy, then Rosetta would take my first claim/decoy of 3, add the second persons claim of 3/decoy and come up with a total of 6, then divide by the number of decoys of that "group???" returned, which is now 2. That would mean the second person would get 3 for his decoy returned. Carry it out thusly: Claimed/decoy, Granted/decoy 1) 3=3 2) (3+3)/2=3 3) (3+3+3)/3=3 .... carry out to the 10 return and it coming from opti CC 10) (3+3+3+3+3+3+3+3+3+9)/10= 36/10= 3.6 etc, etc |
Mod.Sense Volunteer moderator Send message Joined: 22 Aug 06 Posts: 4018 Credit: 0 RAC: 0 |
Ah! OK, yes, collectively we all might run 100,000 decoys on a given type of task. "Model" and "decoy" are synonymous. So, I apologize for missing your meaning, you had said WUs, but I think you meant something more along the lines of a batch of WUs. ...I'm still unclear what your chart is intended to illustrait. Labels on the axis would help. [edit] ...20 out of how many? I've not seen that published. But you can get a feel for the scale by looking at the "results" link under "return participants" on the homepage. ...at least when that function is working. Rosetta Moderator: Mod.Sense |
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
Ah! OK, yes, collectively we all might run 100,000 decoys on a given type of task. Sorry, I editted the last post. Basically the X axis shows each decoy as returned and the Y axis shows the "averaged" granted credit/decoy issued. for example, (assuming stock CC's return "roughly" the same claim/decoy of a particular 'group' or task) I just arbitrarily picked a value of three. (I know it varies with machines,etc). Then when some one using an optimized CC returned one decoy requesting 3X or a claim for 9. Essentially, it shows Rosetta has a method with equalizes credit regardless of which CC one uses (especially after 100 decoys have been returned and is being used in the average). It ensures credit is as fair, if not fairer than the vast majority of Boinc projects available. Also, since it closely follows that of the "Boinc Standard", and deviation is small, then credit comparisons between users is more meaningfull, than that of many boinc projects, since it ensures everyone gets nearly the same for the same amount of work applied. In other words, a variation of 3X, such as with Opti CC's, is an extreme compared to the smaller variations in standard CC's, so if credit can be "equalized" with the CC's variation, then variations between processors/benchmarks is smaller and should happen more quickly. |
David E K Volunteer moderator Project administrator Project developer Project scientist Send message Joined: 1 Jul 05 Posts: 1018 Credit: 4,334,829 RAC: 0 |
Here's a plot of the actual average credit/model value used for a particular job. |
Astro Send message Joined: 2 Oct 05 Posts: 987 Credit: 500,253 RAC: 0 |
Here's a plot of the actual average credit/model value used for a particular job. Job,, that's the word which eluded me earlier.. And DK uses Model instead of Decoy (committing to memory). My chart using a fixed guess of 3 and only carrying it to 5K models (used to say decoys) doesn't show the gentle rise over time that the actual chart does. However, both the real and my guess show relatively even credit across the jobs life, and a similar unrest at the begining of a run of a job. Kewl |
Nothing But Idle Time Send message Joined: 28 Sep 05 Posts: 209 Credit: 139,545 RAC: 0 |
John Galt 007 wrote: I think what the original poster is getting at is what I am experiencing: The difference between claimed and granted is about 44%. It seems that all of my results end up with a lower granted than claimed. Same here. I went to Boinc Combined Stats site and averaged the ratios for all the projects (columns) in the Rosetta row. The average was 0.817 which I interpret to mean that Rosetta is giving 18.3% less credit than the average of all other projects. I think the credit algorithm is fair but the amount of credit granted per unit of time seems low compared to the amount claimed and the amount granted by other projects. If credit chasing is what drives you I presume you would take your cpus elsewhere? Just my opinion; my resource share is reduced to just 7% now where it used to be 50%. |
Message boards :
Number crunching :
Credit system seems unfair, anyone else thinks so?
©2024 University of Washington
https://www.bakerlab.org