-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathbenchmark
1923 lines (1858 loc) · 96.4 KB
/
benchmark
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
This is my (Moshe Looks) messy log of how various versions of plop have done on
benchmark problems as the coding has progressesed. An fully automated system
would be nicer, but this gets the job done.
2/27
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 8.499617678628496
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 61.19718861864694
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 60.8699657962784
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 10.171759537263155
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 3.752245422436409
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 11.215947928056174
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 77.24826610464181
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 84.76854817027991
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.38848382949054
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 19.277756177208246
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 12.555715864606878
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 27.4067206392183
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 63.74255511933906
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 28.452746716276778
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 11.520208591819893
KOZA-POLYNOMIAL-2 passed with cost 118
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 7.8519880177055965
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 28.346653489052155
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 84.33685394583416
KOZA-POLYNOMIAL-2 passed with cost 12
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 52.327991050573274
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 72.18736129233828
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 84.65439802140395
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 12.272907396944522
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 78.30539702734887
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 33.03861227956263
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 71.17266869747003
KOZA-POLYNOMIAL-2 passed with cost 97
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 45.62648783098566
KOZA-POLYNOMIAL-2 passed with cost 179
Evaluation took:
21.124 seconds of real time
19.806679 seconds of total run time (18.447485 user, 1.359194 system)
[ Run times consist of 2.380 seconds GC time, and 17.427 seconds non-GC time. ]
93.77% CPU
50,370,894,540 processor cycles
909,700,408 bytes consed
; (maxima::meval*
; (list (list 'maxima::$radcan)
; mexpr))
; (maxima::fullratsimp mexpr))
3/1
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'lllsc-benchmarker)))
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 57
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 142
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 469
EASY-BOOL passed with cost 236
EASY-BOOL passed with cost 116
EASY-BOOL passed with cost 70
EASY-BOOL passed with cost 63
EASY-BOOL passed with cost 335
EASY-BOOL passed with cost 124
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 396
EASY-BOOL passed with cost 459
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 476
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 132
EASY-BOOL passed with cost 68
EASY-BOOL passed with cost 116
EASY-BOOL passed with cost 195
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 244
EASY-BOOL passed with cost 75
EASY-BOOL passed with cost 18
EASY-BOOL passed with cost 40
Evaluation took:
4.356 seconds of real time
4.114294 seconds of total run time (3.988068 user, 0.126226 system)
[ Run times consist of 0.180 seconds GC time, and 3.935 seconds non-GC time. ]
94.44% CPU
10,400,702,067 processor cycles
315,894,728 bytes consed
after fixing some bugs in reduction
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'lllsc-benchmarker)))
EASY-BOOL passed with cost 62
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 23
EASY-BOOL passed with cost 320
EASY-BOOL passed with cost 268
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 278
EASY-BOOL passed with cost 337
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 104
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 160
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 33
EASY-BOOL passed with cost 57
EASY-BOOL passed with cost 70
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 25
EASY-BOOL passed with cost 160
EASY-BOOL passed with cost 97
EASY-BOOL passed with cost 207
EASY-BOOL passed with cost 72
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 23
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 231
EASY-BOOL passed with cost 462
EASY-BOOL passed with cost 223
EASY-BOOL passed with cost 284
Evaluation took:
3.896 seconds of real time
3.809149 seconds of total run time (3.690424 user, 0.118725 system)
[ Run times consist of 0.177 seconds GC time, and 3.633 seconds non-GC time. ]
97.77% CPU
9,303,893,172 processor cycles
298,355,936 bytes consed
3/4 after fixing more bugs and adding new bool rules
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 172
EASY-BOOL passed with cost 153
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 342
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 277
EASY-BOOL passed with cost 253
EASY-BOOL passed with cost 251
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 296
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 147
EASY-BOOL passed with cost 82
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 179
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 368
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 89
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 20
EASY-BOOL passed with cost 64
EASY-BOOL failed with cost 500, best score was 3.75.
EASY-BOOL passed with cost 420
Evaluation took:
3.225 seconds of real time
3.164931 seconds of total run time (3.015830 user, 0.149101 system)
[ Run times consist of 0.314 seconds GC time, and 2.851 seconds non-GC time. ]
98.14% CPU
7,701,032,187 processor cycles
223,064,520 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 6.429378642714958
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 3.911577123021232
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 28.012971356745776
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 7.043313271976012
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 27.05331576479231
KOZA-POLYNOMIAL-2 passed with cost 65
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 7.54664294857974
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 19.90335672737961
KOZA-POLYNOMIAL-2 passed with cost 15
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 49.18087992100334
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 37.24426316312382
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 21.593718034153078
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 12.000946998525466
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 23.537482719199243
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 43.5902857146957
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 24.16110080751709
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 16.849557996210972
KOZA-POLYNOMIAL-2 passed with cost 13
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 40.39226697318874
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 46.93026551670598
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 55.60489828498749
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 33.2856643369666
KOZA-POLYNOMIAL-2 passed with cost 16
KOZA-POLYNOMIAL-2 passed with cost 18
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 12.09050993139697
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 23.011689507146492
KOZA-POLYNOMIAL-2 passed with cost 9
KOZA-POLYNOMIAL-2 passed with cost 27
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 86.79454927516359
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 41.47462262180588
Evaluation took:
14.311 seconds of real time
13.532204 seconds of total run time (12.752010 user, 0.780194 system)
[ Run times consist of 2.015 seconds GC time, and 11.518 seconds non-GC time. ]
94.56% CPU
34,020,287,406 processor cycles
723,420,888 bytes consed
PLOP> (time (run-benchmarks #'run-lllsc 5000))
KOZA-POLYNOMIAL-1 failed with cost 100, best score was 12.376365147001405
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 22.41141114269419
EASY-BOOL passed with cost 460
MULTIPLEXER-1 passed with cost 6
DEJONG-SPHERE-3 passed with cost 289
DEJONG-SPHERE-4 passed with cost 426
KOZA-POLYNOMIAL-3 failed with cost 900, best score was 15.271935238370265
LINEAR-FUNS-1 failed with cost 1000, best score was 5.434241569202136
DEJONG-SPHERE-5 passed with cost 728
EVEN-PARITY-2 failed with cost 1064, best score was 3.25
DEJONG-SPHERE-6 passed with cost 774
DEJONG-SPHERE-7 passed with cost 1043
KOZA-POLYNOMIAL-4 failed with cost 1600, best score was 49.529721268538104
DEJONG-SPHERE-8 passed with cost 1067
DEJONG-SPHERE-9 passed with cost 1257
LINEAR-FUNS-2 failed with cost 2000, best score was 8.479625077401863
DEJONG-SPHERE-10 passed with cost 1274
KOZA-POLYNOMIAL-5 failed with cost 2500, best score was 63.956463739617405
LINEAR-FUNS-3 failed with cost 3000, best score was 17.207784795793284
DEJONG-ROSENBROCK-2 failed with cost 3000, best score was 1.3207434451514677
EVEN-PARITY-3 failed with cost 3187, best score was 5.75
KOZA-POLYNOMIAL-6 failed with cost 3600, best score was 63.26637552181788
ONEMAX-60 passed with cost 657
LINEAR-FUNS-4 failed with cost 4000, best score was 25.919339535851307
ONEMAX-120 passed with cost 856
DEJONG-ROSENBROCK-3 failed with cost 4500, best score was 1.3686054731722268
ONEMAX-180 passed with cost 1683
KOZA-POLYNOMIAL-7 failed with cost 4900, best score was 47.69778402751664
LINEAR-FUNS-5 failed with cost 5000, best score was 29.295231081977988
DEJONG-STEP-5 passed with cost 19
DEJONG-FOXHOLES-2 failed with cost 5000, best score was 18.69090731435206
success rate: 14 / 31
Evaluation took:
111.695 seconds of real time
108.886273 seconds of total run time (104.060448 user, 4.825825 system)
[ Run times consist of 4.583 seconds GC time, and 104.304 seconds non-GC time. ]
97.49% CPU
266,738,476,509 processor cycles
3/12
with $ratsimp in second fixed-point arg
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 4.966754863779778
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 76.90789645410469
KOZA-POLYNOMIAL-2 passed with cost 9
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 55.90003033081411
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 42.83792038786862
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 79.56134597017869
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 76.90789645410469
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 46.47212865015582
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 78.40688299623349
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 44.91018147579903
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 11.195890189893163
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 14.14567009609964
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 37.18150681533743
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 79.0479998710024
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 45.92437287003401
KOZA-POLYNOMIAL-2 passed with cost 20
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 77.93633549077501
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 46.08174259389208
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 79.08524388517768
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 13.394535100362306
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 5.901965677591419
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 23.145087519215664
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 61.873183857774855
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 13.848743313964748
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 33.17480179611452
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 76.8891217435667
KOZA-POLYNOMIAL-2 passed with cost 17
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 77.8695323747111
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 83.24620986698312
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 80.12218267497651
Evaluation took:
30.130 seconds of real time
27.569683 seconds of total run time (26.010348 user, 1.559335 system)
[ Run times consist of 3.507 seconds GC time, and 24.063 seconds non-GC time. ]
91.50% CPU
68,578,279,200 processor cycles
1,275,820,160 bytes consed
3/17
many bugfixes, improved prior
PLOP> (time (run-benchmarks #'run-lllsc 5000))
KOZA-POLYNOMIAL-1 passed with cost 12
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 40.735151788125535
EASY-BOOL passed with cost 46
MULTIPLEXER-1 passed with cost 77
DEJONG-SPHERE-3 passed with cost 314
DEJONG-SPHERE-4 passed with cost 524
KOZA-POLYNOMIAL-3 failed with cost 900, best score was 60.69026969710694
LINEAR-FUNS-1 failed with cost 1000, best score was 12.972446607794762
DEJONG-SPHERE-5 passed with cost 464
EVEN-PARITY-2 failed with cost 1064, best score was 10.0
DEJONG-SPHERE-6 passed with cost 906
DEJONG-SPHERE-7 passed with cost 1158
KOZA-POLYNOMIAL-4 failed with cost 1600, best score was 69.22042925664314
DEJONG-SPHERE-8 passed with cost 1373
DEJONG-SPHERE-9 passed with cost 1413
LINEAR-FUNS-2 failed with cost 2000, best score was 20.40474196205479
DEJONG-SPHERE-10 passed with cost 1456
KOZA-POLYNOMIAL-5 failed with cost 2500, best score was 57.32523164028789
LINEAR-FUNS-3 failed with cost 3000, best score was 23.312316791222877
DEJONG-ROSENBROCK-2 failed with cost 3000, best score was 15.524110019429711
EVEN-PARITY-3 failed with cost 3187, best score was 26.584962487220764
KOZA-POLYNOMIAL-6 failed with cost 3600, best score was 60.92323374696466
ONEMAX-60 passed with cost 312
LINEAR-FUNS-4 failed with cost 4000, best score was 25.931341225421768
ONEMAX-120 passed with cost 1290
DEJONG-ROSENBROCK-3 failed with cost 4500, best score was 1.104970127917692
ONEMAX-180 passed with cost 1020
KOZA-POLYNOMIAL-7 failed with cost 4900, best score was 51.91250871294504
LINEAR-FUNS-5 failed with cost 5000, best score was 38.0107914529258
DEJONG-STEP-5 passed with cost 49
DEJONG-FOXHOLES-2 failed with cost 5000, best score was 19.374406500489222
success rate: 15 / 31
Evaluation took:
85.468 seconds of real time
77.762697 seconds of total run time (73.782196 user, 3.980501 system)
[ Run times consist of 4.423 seconds GC time, and 73.340 seconds non-GC time. ]
90.98% CPU
201,848,244,786 processor cycles
4,628,292,672 bytes consed
PLOP> (time (run-tests))
TOTAL: 33927 assertions passed, 0 failed, 0 execution errors.
Evaluation took:
10.935 seconds of real time
9.898528 seconds of total run time (9.663106 user, 0.235422 system)
[ Run times consist of 0.602 seconds GC time, and 9.297 seconds non-GC time. ]
90.53% CPU
75 forms interpreted
3,548 lambdas converted
25,584,664,842 processor cycles
717,038,184 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.4982877623543
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.58543703956752
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 57.18635293208425
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 31.508086303366113
KOZA-POLYNOMIAL-2 passed with cost 9
KOZA-POLYNOMIAL-2 passed with cost 255
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 55.201468762922865
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 40.735151788125535
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.371399914253885
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 29.76018372965034
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.371399914253885
KOZA-POLYNOMIAL-2 passed with cost 13
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 36.57026680091618
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.84634213398126
KOZA-POLYNOMIAL-2 passed with cost 134
KOZA-POLYNOMIAL-2 passed with cost 9
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 55.92186990069371
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 72.4703030458231
KOZA-POLYNOMIAL-2 passed with cost 15
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 59.161688206821324
KOZA-POLYNOMIAL-2 passed with cost 24
KOZA-POLYNOMIAL-2 passed with cost 15
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 45.15365067696117
KOZA-POLYNOMIAL-2 passed with cost 13
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 34.77007930580777
KOZA-POLYNOMIAL-2 passed with cost 28
KOZA-POLYNOMIAL-2 passed with cost 26
KOZA-POLYNOMIAL-2 passed with cost 7
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.371399914253885
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 45.15365067696117
Evaluation took:
17.628 seconds of real time
16.865868 seconds of total run time (16.144798 user, 0.721070 system)
[ Run times consist of 0.924 seconds GC time, and 15.942 seconds non-GC time. ]
95.68% CPU
42,093,982,017 processor cycles
891,487,112 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'run-lllsc)))
EASY-BOOL passed with cost 114
EASY-BOOL passed with cost 180
EASY-BOOL passed with cost 79
EASY-BOOL passed with cost 89
EASY-BOOL passed with cost 63
EASY-BOOL passed with cost 81
EASY-BOOL passed with cost 96
EASY-BOOL passed with cost 59
EASY-BOOL passed with cost 123
EASY-BOOL passed with cost 52
EASY-BOOL passed with cost 100
EASY-BOOL passed with cost 97
EASY-BOOL passed with cost 40
EASY-BOOL passed with cost 32
EASY-BOOL passed with cost 34
EASY-BOOL passed with cost 53
EASY-BOOL passed with cost 25
EASY-BOOL passed with cost 19
EASY-BOOL passed with cost 102
EASY-BOOL passed with cost 50
EASY-BOOL passed with cost 39
EASY-BOOL passed with cost 77
EASY-BOOL passed with cost 63
EASY-BOOL passed with cost 73
EASY-BOOL passed with cost 101
EASY-BOOL passed with cost 82
EASY-BOOL passed with cost 106
EASY-BOOL passed with cost 34
EASY-BOOL passed with cost 25
EASY-BOOL passed with cost 79
Evaluation took:
0.879 seconds of real time
0.852517 seconds of total run time (0.837245 user, 0.015272 system)
[ Run times consist of 0.044 seconds GC time, and 0.809 seconds non-GC time. ]
97.04% CPU
2,099,490,012 processor cycles
69,828,344 bytes consed
with the weight on the prior tuned way down
PLOP> (time (dorepeat 30 (run-benchmark 'even-parity-3 #'run-lllsc)))
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 passed with cost 3185
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 passed with cost 2601
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 passed with cost 1110
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 passed with cost 2225
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
Evaluation took:
188.551 seconds of real time
168.396752 seconds of total run time (157.226034 user, 11.170718 system)
[ Run times consist of 16.313 seconds GC time, and 152.084 seconds non-GC time. ]
89.31% CPU
439,501,830,606 processor cycles
9,523,534,472 bytes consed
3/18
after some profiling and performance tuning
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'run-lllsc)))
EASY-BOOL passed with cost 74
EASY-BOOL passed with cost 46
EASY-BOOL passed with cost 69
EASY-BOOL passed with cost 42
EASY-BOOL passed with cost 48
EASY-BOOL passed with cost 71
EASY-BOOL passed with cost 149
EASY-BOOL passed with cost 99
EASY-BOOL passed with cost 96
EASY-BOOL passed with cost 50
EASY-BOOL passed with cost 25
EASY-BOOL passed with cost 46
EASY-BOOL passed with cost 17
EASY-BOOL passed with cost 66
EASY-BOOL passed with cost 52
EASY-BOOL passed with cost 114
EASY-BOOL passed with cost 69
EASY-BOOL passed with cost 95
EASY-BOOL passed with cost 101
EASY-BOOL passed with cost 96
EASY-BOOL passed with cost 89
EASY-BOOL passed with cost 145
EASY-BOOL passed with cost 57
EASY-BOOL passed with cost 67
EASY-BOOL passed with cost 47
EASY-BOOL passed with cost 58
EASY-BOOL passed with cost 149
EASY-BOOL passed with cost 88
EASY-BOOL passed with cost 149
EASY-BOOL passed with cost 58
Evaluation took:
0.736 seconds of real time
0.720532 seconds of total run time (0.706793 user, 0.013739 system)
[ Run times consist of 0.052 seconds GC time, and 0.669 seconds non-GC time. ]
97.96% CPU
1,758,456,072 processor cycles
61,233,376 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 passed with cost 77
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 38.08315171116185
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 passed with cost 40
KOZA-POLYNOMIAL-2 passed with cost 141
KOZA-POLYNOMIAL-2 passed with cost 27
KOZA-POLYNOMIAL-2 passed with cost 59
KOZA-POLYNOMIAL-2 passed with cost 13
KOZA-POLYNOMIAL-2 passed with cost 17
KOZA-POLYNOMIAL-2 passed with cost 103
KOZA-POLYNOMIAL-2 passed with cost 47
KOZA-POLYNOMIAL-2 passed with cost 398
KOZA-POLYNOMIAL-2 passed with cost 156
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 35.36164338069637
KOZA-POLYNOMIAL-2 passed with cost 36
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 43.20570304987847
KOZA-POLYNOMIAL-2 passed with cost 11
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 84.38734657148494
KOZA-POLYNOMIAL-2 passed with cost 55
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 63.890636025418075
KOZA-POLYNOMIAL-2 passed with cost 194
KOZA-POLYNOMIAL-2 passed with cost 47
KOZA-POLYNOMIAL-2 passed with cost 46
KOZA-POLYNOMIAL-2 passed with cost 43
KOZA-POLYNOMIAL-2 passed with cost 45
KOZA-POLYNOMIAL-2 passed with cost 17
Evaluation took:
8.839 seconds of real time
8.541513 seconds of total run time (8.149238 user, 0.392275 system)
[ Run times consist of 0.611 seconds GC time, and 7.931 seconds non-GC time. ]
96.64% CPU
21,055,874,679 processor cycles
514,310,264 bytes consed
3/23 sanity check, should be the same as before (new lru, update-freqs)
or maybe slightly slower
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'run-lllsc)))
EASY-BOOL passed with cost 56
EASY-BOOL passed with cost 58
EASY-BOOL passed with cost 40
EASY-BOOL passed with cost 61
EASY-BOOL passed with cost 29
EASY-BOOL passed with cost 195
EASY-BOOL passed with cost 64
EASY-BOOL passed with cost 89
EASY-BOOL passed with cost 91
EASY-BOOL passed with cost 39
EASY-BOOL passed with cost 27
EASY-BOOL passed with cost 102
EASY-BOOL passed with cost 241
EASY-BOOL passed with cost 27
EASY-BOOL passed with cost 38
EASY-BOOL passed with cost 137
EASY-BOOL passed with cost 42
EASY-BOOL passed with cost 113
EASY-BOOL passed with cost 22
EASY-BOOL passed with cost 121
EASY-BOOL passed with cost 12
EASY-BOOL passed with cost 45
EASY-BOOL passed with cost 83
EASY-BOOL passed with cost 69
EASY-BOOL passed with cost 60
EASY-BOOL passed with cost 29
EASY-BOOL passed with cost 141
EASY-BOOL passed with cost 67
EASY-BOOL passed with cost 41
EASY-BOOL passed with cost 95
Evaluation took:
0.712 seconds of real time
0.686922 seconds of total run time (0.647800 user, 0.039122 system)
[ Run times consist of 0.085 seconds GC time, and 0.602 seconds non-GC time. ]
96.49% CPU
1,700,348,958 processor cycles
53,165,472 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 42
KOZA-POLYNOMIAL-2 passed with cost 25
KOZA-POLYNOMIAL-2 passed with cost 8
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 70.87766591572975
KOZA-POLYNOMIAL-2 passed with cost 19
KOZA-POLYNOMIAL-2 passed with cost 53
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 63.226980627166895
KOZA-POLYNOMIAL-2 passed with cost 20
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 61.41639681398886
KOZA-POLYNOMIAL-2 passed with cost 11
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.29922081185123
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 56.712131042526835
KOZA-POLYNOMIAL-2 passed with cost 14
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 26
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 73.52131137641408
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 31.19026767228909
KOZA-POLYNOMIAL-2 passed with cost 19
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 60.148462738261486
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 75.89808098320961
KOZA-POLYNOMIAL-2 passed with cost 132
KOZA-POLYNOMIAL-2 passed with cost 78
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 40
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 64
Evaluation took:
12.840 seconds of real time
12.378013 seconds of total run time (11.888926 user, 0.489087 system)
[ Run times consist of 0.742 seconds GC time, and 11.637 seconds non-GC time. ]
96.40% CPU
30,610,198,260 processor cycles
668,686,104 bytes consed
3/24 added a panic factor
PLOP> (time (dorepeat 30 (run-benchmark 'even-parity-3 #'run-lllsc)))
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 passed with cost 3098
EVEN-PARITY-3 passed with cost 2827
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 passed with cost 1885
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
EVEN-PARITY-3 passed with cost 2300
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
EVEN-PARITY-3 failed with cost 3187, best score was 621.1699249744415
Evaluation took:
125.858 seconds of real time
121.849058 seconds of total run time (115.923486 user, 5.925572 system)
[ Run times consist of 11.567 seconds GC time, and 110.283 seconds non-GC time. ]
96.81% CPU
300,557,401,587 processor cycles
7,292,978,928 bytes consed
PLOP> (time (run-benchmarks #'run-lllsc 5000))
KOZA-POLYNOMIAL-1 passed with cost 7
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 58.943257611910674
EASY-BOOL passed with cost 72
MULTIPLEXER-1 passed with cost 28
DEJONG-SPHERE-3 passed with cost 505
DEJONG-SPHERE-4 passed with cost 662
KOZA-POLYNOMIAL-3 failed with cost 900, best score was 69.75480106975152
LINEAR-FUNS-1 failed with cost 1000, best score was 8.887586798671045
DEJONG-SPHERE-5 passed with cost 491
EVEN-PARITY-2 passed with cost 69
DEJONG-SPHERE-6 passed with cost 897
DEJONG-SPHERE-7 passed with cost 1157
KOZA-POLYNOMIAL-4 failed with cost 1600, best score was 72.00164826389948
DEJONG-SPHERE-8 passed with cost 1135
DEJONG-SPHERE-9 passed with cost 1226
LINEAR-FUNS-2 failed with cost 2000, best score was 16.322209490792964
DEJONG-SPHERE-10 passed with cost 1278
KOZA-POLYNOMIAL-5 failed with cost 2500, best score was 30.109714883837068
LINEAR-FUNS-3 failed with cost 3000, best score was 22.177453678540765
DEJONG-ROSENBROCK-2 failed with cost 3000, best score was 11.266403167757607
EVEN-PARITY-3 failed with cost 3187, best score was 1214.5849624872208
KOZA-POLYNOMIAL-6 failed with cost 3600, best score was 57.878155232582046
ONEMAX-60 passed with cost 411
LINEAR-FUNS-4 failed with cost 4000, best score was 25.829262273929746
ONEMAX-120 passed with cost 1007
DEJONG-ROSENBROCK-3 failed with cost 4500, best score was 2.101145003065576
ONEMAX-180 passed with cost 2074
KOZA-POLYNOMIAL-7 failed with cost 4900, best score was 42.88424515016003
LINEAR-FUNS-5 failed with cost 5000, best score was 38.30789742438084
DEJONG-STEP-5 passed with cost 32
DEJONG-FOXHOLES-2 failed with cost 5000, best score was 20.30430951916727
success rate: 16 / 31
Evaluation took:
63.869 seconds of real time
61.790820 seconds of total run time (58.957305 user, 2.833515 system)
[ Run times consist of 3.907 seconds GC time, and 57.884 seconds non-GC time. ]
96.75% CPU
152,525,247,750 processor cycles
3,591,369,560 bytes consed
3/27 implemented and integrated dyads and super-lru
PLOP> (time (run-tests))
TOTAL: 33974 assertions passed, 0 failed, 0 execution errors.
Evaluation took:
8.282 seconds of real time
7.832231 seconds of total run time (7.674868 user, 0.157363 system)
[ Run times consist of 0.584 seconds GC time, and 7.249 seconds non-GC time. ]
94.57% CPU
78 forms interpreted
3,960 lambdas converted
19,778,565,159 processor cycles
649,683,664 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'easy-bool #'run-lllsc)))
EASY-BOOL passed with cost 43
EASY-BOOL passed with cost 56
EASY-BOOL passed with cost 36
EASY-BOOL passed with cost 69
EASY-BOOL passed with cost 68
EASY-BOOL passed with cost 136
EASY-BOOL passed with cost 92
EASY-BOOL passed with cost 42
EASY-BOOL passed with cost 49
EASY-BOOL passed with cost 51
EASY-BOOL passed with cost 85
EASY-BOOL passed with cost 128
EASY-BOOL passed with cost 48
EASY-BOOL passed with cost 65
EASY-BOOL passed with cost 32
EASY-BOOL passed with cost 145
EASY-BOOL passed with cost 27
EASY-BOOL passed with cost 46
EASY-BOOL passed with cost 80
EASY-BOOL passed with cost 66
EASY-BOOL passed with cost 41
EASY-BOOL passed with cost 58
EASY-BOOL passed with cost 57
EASY-BOOL passed with cost 63
EASY-BOOL passed with cost 59
EASY-BOOL passed with cost 108
EASY-BOOL passed with cost 89
EASY-BOOL passed with cost 37
EASY-BOOL passed with cost 99
EASY-BOOL passed with cost 67
Evaluation took:
0.701 seconds of real time
0.665429 seconds of total run time (0.630993 user, 0.034436 system)
[ Run times consist of 0.053 seconds GC time, and 0.613 seconds non-GC time. ]
94.86% CPU
1,674,068,535 processor cycles
54,206,192 bytes consed
PLOP> (time (dorepeat 30 (run-benchmark 'koza-polynomial-2 #'run-lllsc)))
KOZA-POLYNOMIAL-2 passed with cost 11
KOZA-POLYNOMIAL-2 passed with cost 15
KOZA-POLYNOMIAL-2 passed with cost 31
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 42
KOZA-POLYNOMIAL-2 passed with cost 25
KOZA-POLYNOMIAL-2 passed with cost 8
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 70.87766591572975
KOZA-POLYNOMIAL-2 passed with cost 19
KOZA-POLYNOMIAL-2 passed with cost 53
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 63.226980627166895
KOZA-POLYNOMIAL-2 passed with cost 20
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 61.41639681398886
KOZA-POLYNOMIAL-2 passed with cost 11
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 54.29922081185123
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 56.712131042526835
KOZA-POLYNOMIAL-2 passed with cost 14
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 passed with cost 26
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 73.52131137641408
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 31.19026767228909
KOZA-POLYNOMIAL-2 passed with cost 19
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 60.148462738261486
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 75.89808098320961
KOZA-POLYNOMIAL-2 passed with cost 132
KOZA-POLYNOMIAL-2 passed with cost 78
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 39.86467763866053
Evaluation took:
12.262 seconds of real time
11.878257 seconds of total run time (11.390993 user, 0.487264 system)
[ Run times consist of 0.713 seconds GC time, and 11.166 seconds non-GC time. ]
96.87% CPU
29,281,965,156 processor cycles
641,685,136 bytes consed
((+ SIMP NIL) 0 0 0 0 0
((* SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
1 1 1 1 1 X ((+ SIMP NIL) 0 0 0 0
((EXP SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
((* SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
1 1 1
((+ SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
1.0f0 ((SIN SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
((+ SIMP (FLATTEN-ASSOCIATIVE)) 0
((* SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
-0.01 X))))
1
((+ SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
0 0 0 0 0 X
((* SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
-1.0 1 1 ((+ SIMP (FLATTEN-ASSOCIATIVE)) 0.99 0.0f0) 1
((+ SIMP NIL) 0 0 0 0
((EXP SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
((+ SIMP NIL) 0 0 0 0 0 ((* SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
3.5 1 1 1 1
((EXP SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
X)
((+ SIMP NIL) 0 0 0 0 ((LOG SIMP
(MAXIMA-PREPARE IF-IDENTITIES FLATTEN-ASSOCIATIVE
RING-OP-IDENTITIES))
1)))))))))))))
((+ SIMP NIL) 0 0 0 0 0 ((* SIMP #) 1 1 1 (# 1.0f0 #) X)))))))))))))))
PLOP> (profile '(run-benchmark 'koza-polynomial-2 #'run-lllsc))
KOZA-POLYNOMIAL-2 failed with cost 400, best score was 61.842009782786974
measuring PROFILE overhead..done
seconds | consed | calls | sec/call | name
-------------------------------------------------------------
0.910 | 32,370,112 | 1,364 | 0.000667 | VISIT-ROOT-ONLY
0.068 | 396,856 | 105,019 | 0.000001 | SET-MARK
0.043 | 0 | 723 | 0.000060 | LRU-LOOKUP
0.023 | 159,448 | 185 | 0.000127 | LRU-GET
0.018 | 4,096 | 11,524 | 0.000002 | FN-BODY
0.018 | 3,602,776 | 21,272 | 0.000001 | CLEAR-SIMP
0.017 | 1,346,912 | 7,004 | 0.000002 | ADDR-EQUAL-TWIDDLES
0.012 | 1,734,936 | 1,649 | 0.000007 | COUNT-BITS
0.012 | 1,048,136 | 5,709 | 0.000002 | FN-ARGS
0.011 | 2,484,728 | 4,857 | 0.000002 | ARG-TYPES
0.010 | 4,088 | 21,312 | 0.0000004 | ASSOCIATIVEP
0.008 | 3,418,088 | 6,640 | 0.000001 | ATOM-PRIOR-PENALTY
0.007 | 4,096 | 18,910 | 0.0000004 | IFN
0.007 | 0 | 2,598 | 0.000003 | EQFN
0.007 | 0 | 14,203 | 0.0000005 | ICAR
0.006 | 0 | 105,370 | 0.0000001 | SIMPP
0.006 | 257,920 | 723 | 0.000008 | GENERATE
0.005 | 114,520 | 2,042 | 0.000002 | MAKE-KNOB
0.004 | 0 | 1,488 | 0.000003 | REDUCTIONS
0.004 | 0 | 4,857 | 0.000001 | ARITY
0.004 | 368,216 | 1,050 | 0.000004 | MAKE-REPLACER-KNOB
0.004 | 1,408,208 | 992 | 0.000004 | NUMARG-TERMS
0.003 | 122,824 | 2,100 | 0.000002 | SPLIT-BY-COEFFICIENTS
0.003 | 380,152 | 723 | 0.000004 | MAKE-SAMPLER
0.003 | 1,028,088 | 2,042 | 0.000002 | KNOB-NBITS
0.003 | 298,800 | 723 | 0.000004 | TWIDDLES-MAGNITUDE
0.003 | 0 | 6,290 | 0.0000004 | EQL-LENGTH-P
0.003 | 1,351,088 | 7,561 | 0.0000003 | EPSILON-SIZE
0.003 | 0 | 1,401 | 0.000002 | MUNG1S
0.002 | 0 | 22,988 | 0.0000001 | SYMBOLS-WITH-TYPE
0.002 | 0 | 724 | 0.000003 | TUPLE-VALUE-P
0.002 | 1,878,800 | 11,090 | 0.0000002 | UNBIND-SYMBOL
0.002 | 226,880 | 504 | 0.000004 | MAKE-ADDR
0.002 | 61,408 | 185 | 0.000009 | LRU-IMMORTALIZE
0.001 | 20,464 | 212 | 0.000007 | ERF
0.001 | 16,376 | 1,455 | 0.000001 | MAKE-LAMBDA-LIST
0.001 | 106,448 | 732 | 0.000002 | MKLAMBDA-LIST
0.001 | 0 | 681 | 0.000002 | LRU-NODE-IMMORTAL-P
0.001 | 356,208 | 2,100 | 0.000001 | DUAL-DECOMPOSE
0.001 | 0 | 2,042 | 0.000001 | BIG-EPSILON
0.001 | 192,368 | 1,050 | 0.000001 | KEYS
0.001 | 0 | 3,376 | 0.0000002 | VALUEDP
0.001 | 0 | 110 | 0.000007 | NUM-DUAL
0.001 | 0 | 988 | 0.000001 | SET-ARG0
0.001 | 0 | 185 | 0.000003 | LRU-FULL-P
0.001 | 12,264 | 185 | 0.000003 | MAKE-PNODE
0.0003 | 684,032 | 49,527 | 0.0000000 | PCONS
0.0003 | 0 | 723 | 0.0000004 | RANDOM-PICK-PROB
0.0003 | 16,352 | 723 | 0.0000004 | PROBLEM-LOSER-BOUND
0.0002 | 0 | 5,709 | 0.0000000 | LAMBDA-LIST-ARGNAMES
0.0001 | 0 | 2,042 | 0.0000000 | LITTLE-EPSILON
0.000 | 1,547,528 | 9,313 | 0.000000 | VALUE-TYPE
0.000 | 0 | 45,088 | 0.000000 | CANONP
0.000 | 135,080 | 212 | 0.000000 | UPDATE-FREQUENCIES-LOSER
0.000 | 282,520 | 1,777 | 0.000000 | BIND-TYPE
0.000 | 323,424 | 2,100 | 0.000000 | SPLIT-BY-OP
0.000 | 0 | 1 | 0.000000 | MAKE-ARG-NAMES
0.000 | 0 | 1,441 | 0.000000 | KNOB-SETTING-DISTANCE
0.000 | 0 | 1 | 0.000000 | MAKE-PROBLEM-RAW
0.000 | 0 | 370 | 0.000000 | LRU-NODE-DISCONNECTED-P
0.000 | 32,728 | 212 | 0.000000 | PROBLEM-ERR-MOMENTS
0.000 | 28,648 | 3 | 0.000000 | MIN-ELEMENT
0.000 | 8,176 | 185 | 0.000000 | MAKE-LRU-NODE
0.000 | 0 | 1 | 0.000000 | MAKE-ADDR-ROOT
0.000 | 10,888,640 | 723 | 0.000000 | SCORE-EXPR-UNLESS-LOSER
0.000 | 0 | 1,511 | 0.000000 | SET-CANON-PARENT
0.000 | 786,000 | 2,250 | 0.000000 | COPY-CANON
0.000 | 20,480 | 8 | 0.000000 | REP-NBITS
0.000 | 0 | 58,479 | 0.000000 | AFN
0.000 | 0 | 6,640 | 0.000000 | N-SYMBOLS-WITH-TYPE
0.000 | 14,200 | 8 | 0.000000 | COMPUTE-KNOBS
0.000 | 0 | 724 | 0.000000 | PUREP
0.000 | 3,049,496 | 9,313 | 0.000000 | LOOKUP-VALUE-TYPE
0.000 | 0 | 22,716 | 0.000000 | LAMBDAP
0.000 | 4,088 | 8 | 0.000000 | CCONS-LAMBDA
0.000 | 712,400 | 6,450 | 0.000000 | CONST-ATOM-P
0.000 | 4,895,776 | 9,393 | 0.000000 | CUMMULATIVE-FIXED-POINT
0.000 | 281,592 | 1 | 0.000000 | MAKE-LRU
0.000 | 540,312 | 1,511 | 0.000000 | CCONS
0.000 | 4,379,784 | 6,954 | 0.000000 | PRIOR-PENALTY
0.000 | 77,768 | 624 | 0.000000 | SPLIT-PRODUCT-OF-SUMS
0.000 | 0 | 1 | 0.000000 | SCORE-EXPR
0.000 | 122,880 | 4,857 | 0.000000 | NTIMES
0.000 | 4,096 | 8 | 0.000000 | LIST-TYPE-P
0.000 | 0 | 185 | 0.000000 | DYAD-RESULT
0.000 | 0 | 1 | 0.000000 | MAKE-PROBLEM
0.000 | 4,096 | 1,050 | 0.000000 | MAPHASH-KEYS
0.000 | 0 | 1 | 0.000000 | COMPETITIVE-LEARN
0.000 | 4,908,136 | 10,716 | 0.000000 | MUNG
0.000 | 0 | 30,715 | 0.000000 | CLOSUREP
0.000 | 0 | 20,134 | 0.000000 | UNMARK
0.000 | 0 | 19,686 | 0.000000 | SINGLEP
0.000 | 4,096 | 8 | 0.000000 | MAKE-REP
0.000 | 352,016 | 992 | 0.000000 | MAKE-INSERTER-KNOB
0.000 | 0 | 1 | 0.000000 | CURRENT-PROBLEM
0.000 | 282,536 | 723 | 0.000000 | RANDOM-PICK
0.000 | 171,896 | 27 | 0.000000 | CANONIZE
0.000 | 65,512 | 212 | 0.000000 | CONDITIONAL-TAIL-EXPECTATION
0.000 | 3,712,848 | 13,590 | 0.000000 | CONST-EXPR-P
0.000 | 118,728 | 723 | 0.000000 | UPDATE-FREQUENCIES
0.000 | 3,352,528 | 18,891 | 0.000000 | RING-OP-P
0.000 | 3,791,048 | 11,090 | 0.000000 | BIND-VALUE
0.000 | 3,311,872 | 4,300 | 0.000000 | VISIT-DOWNWARDS
0.000 | 0 | 185 | 0.000000 | PNODE-ERR
0.000 | 50,725,568 | 100,319 | 0.000000 | MAPARGS
0.000 | 1,346,792 | 8,298 | 0.000000 | CONVERT-BOOLS
0.000 | 4,088 | 50,189 | 0.000000 | SHORT-CIRCUITS-P
0.000 | 184,184 | 723 | 0.000000 | ERR-DIVERGENCE
0.000 | 159,680 | 724 | 0.000000 | VALUE-TO-EXPR
0.000 | 38,324,632 | 162,467 | 0.000000 | PEVAL-CL
0.000 | 4,096 | 8 | 0.000000 | ENUM-KNOBS
0.000 | 0 | 1 | 0.000000 | MAKE-MPOP
0.000 | 0 | 40,368 | 0.000000 | GETVALUE
0.000 | 270,208 | 724 | 0.000000 | FIND-CONST-REDUCIBLE
0.000 | 2,885,960 | 2,590 | 0.000000 | KNOBS-AT
0.000 | 0 | 724 | 0.000000 | COMMUTATIVEP
0.000 | 0 | 28,132 | 0.000000 | IDENTITY-ELEM
0.000 | 1,580,072 | 2,598 | 0.000000 | MAP-KNOBS
0.000 | 491,088 | 1,050 | 0.000000 | NUMARG-SETTINGS
0.000 | 0 | 20,134 | 0.000000 | CANON-PARENT
0.000 | 241,608 | 723 | 0.000000 | SAMPLE-PICK
0.000 | 5,289,232 | 10,831 | 0.000000 | UNMUNG
0.000 | 7,602,432 | 6,986 | 0.000000 | VISIT-UPWARDS
0.000 | 577,264 | 11,307 | 0.000000 | PCLONE
0.000 | 4,096 | 1 | 0.000000 | RUN-BENCHMARK
0.000 | 0 | 43,610 | 0.000000 | CANON-EXPR
0.000 | 0 | 1 | 0.000000 | FLATNESS
0.000 | 970,448 | 5,689 | 0.000000 | PEQUAL
0.000 | 0 | 9,313 | 0.000000 | LOOKUP-ATOM-TYPE
0.000 | 245,584 | 1,476 | 0.000000 | SPLIT-SUM-OF-PRODUCTS
0.000 | 3,344,656 | 13,381 | 0.000000 | FROM-MAXIMA
0.000 | 76,633,112 | 246,006 | 0.000000 | FIXED-POINT
0.000 | 0 | 8 | 0.000000 | ACAR
0.000 | 0 | 8 | 0.000000 | GET-REP
0.000 | 0 | 2 | 0.000000 | DEFAULT-EXPR
0.000 | 642,752 | 723 | 0.000000 | MAKE-EXPR-FROM-TWIDDLES
0.000 | 3,381,424 | 12,506 | 0.000000 | TO-MAXIMA
0.000 | 36,832 | 1 | 0.000000 | RUN-LLLSC
0.000 | 0 | 8 | 0.000000 | STUCKNESS-BOUND
0.000 | 139,160 | 496 | 0.000000 | MPOP-INSERT
0.000 | 648,080 | 1 | 0.000000 | LL-OPTIMIZE
0.000 | 2,836,896 | 8,300 | 0.000000 | PEVAL