run · rs_emfy0400slply8d7 · graded 2026-09-20 23:41:39graded on sitepublished · anyone who can see the task can open this
Share

laya-421M

convaiinnovations/layatyped-decisions421Mvia tp 0.0.15.dev76+g62a0262on Jev-class: name the weakness class

Grader output

free-form JSON · this task's own · run here
0.266grader.score399 of 1500 cases passed
score
0.266
n_cases=1500n_errors=1101n_scored=1500n_correct=399by_category={"CWE-20":0,"CWE-22":0,"CWE-78":0,"CWE-79":0,"CWE-89":0,"CWE-94":0,"CWE-120":0.…n_timed_out=0n_unanswered=0n_worst_band=530latency_ms_p95=5722n_cost_metered=0latency_ms_median=2535n_with_confidence=1500cases_worst_band_lo=0.9cases_overconfidence=0.5225cases_worst_band_gap=0.458cases_mean_confidence=0.7885cases_unrelated_share=0.9028n_parent_child_errors=107cases_calibration_error=0.5225cases_parent_child_share=0.0972

The task's own judge and grader ran on this site over the answers the agent submitted. This task's reference answers are not published; the site holds them and never sends them to a solver. Which model answered, what it cost and who typed remain the client's word.

Run frame

declared by the client · not validated
cases
1500
duration total · client wall clock
5408.16s
cost
unknown · not reported
engine
convaiinnovations/layatyped-decisions421M
answers
via tp 0.0.15.dev76+g62a0262

run configuration

declared by the client · not validated
launcher
tp 0.0.15.dev76+g62a0262
executor
tp 0.0.15.dev76+g62a0262
framework
laya-mlx
model · declared
convaiinnovations/layatyped-decisions421M (trap.yaml)
solution
https://github.com/Ruqii/trapstreet-solutions@056a05e79755/cve_weakness_class/laya
task
https://github.com/trapstreet/decision-layer-bench@0454940c1a0e/tasks/cve_weakness_class
trap
0.0.15.dev76+g62a0262

environment · self-reported, not validated

os
macOS 14.0
arch
arm64
kernel
Darwin 23.0.0
cpu
Apple M1 · 8 cores
memory
8.0 GB
python
3.13.7

skills & tools used

not reported

data coverage

identity
collected · tp · tp/0.0.15.dev76+g62a0262 · 2026-09-20 23:41:35
model
collected · tp · tp/0.0.15.dev76+g62a0262 · 2026-09-20 23:41:35
environment
collected · tp · tp/0.0.15.dev76+g62a0262 · 2026-09-20 23:41:35
reproducibility
collected · tp · tp/0.0.15.dev76+g62a0262 · 2026-09-20 23:41:35
skills
unsupported · tp runs a solver process; skills are a harness concept
tools
unsupported · tp does not observe the solver's tool calls
timing
collected · tp · tp/0.0.15.dev76+g62a0262 · 2026-09-20 23:41:35
usage
not yet reported · cost unknown · not recorded
cases in this runcase_0001: failcase_0002: failcase_0003: failcase_0004: passcase_0005: failcase_0006: passcase_0007: failcase_0008: failcase_0009: passcase_0010: passcase_0011: failcase_0012: passcase_0013: failcase_0014: passcase_0015: failcase_0016: failcase_0017: failcase_0018: failcase_0019: passcase_0020: failcase_0021: failcase_0022: passcase_0023: failcase_0024: failcase_0025: failcase_0026: failcase_0027: failcase_0028: failcase_0029: failcase_0030: failcase_0031: failcase_0032: failcase_0033: failcase_0034: failcase_0035: failcase_0036: passcase_0037: failcase_0038: passcase_0039: failcase_0040: failcase_0041: failcase_0042: passcase_0043: passcase_0044: failcase_0045: failcase_0046: passcase_0047: failcase_0048: failcase_0049: passcase_0050: failcase_0051: failcase_0052: failcase_0053: failcase_0054: failcase_0055: passcase_0056: failcase_0057: passcase_0058: failcase_0059: passcase_0060: failcase_0061: failcase_0062: failcase_0063: failcase_0064: failcase_0065: failcase_0066: passcase_0067: passcase_0068: failcase_0069: failcase_0070: failcase_0071: passcase_0072: failcase_0073: passcase_0074: failcase_0075: failcase_0076: passcase_0077: passcase_0078: failcase_0079: failcase_0080: failcase_0081: failcase_0082: passcase_0083: failcase_0084: passcase_0085: failcase_0086: passcase_0087: failcase_0088: failcase_0089: failcase_0090: failcase_0091: failcase_0092: passcase_0093: failcase_0094: failcase_0095: passcase_0096: failcase_0097: failcase_0098: failcase_0099: failcase_0100: passcase_0101: failcase_0102: passcase_0103: failcase_0104: failcase_0105: failcase_0106: passcase_0107: failcase_0108: passcase_0109: failcase_0110: failcase_0111: passcase_0112: passcase_0113: failcase_0114: passcase_0115: failcase_0116: failcase_0117: passcase_0118: passcase_0119: passcase_0120: failcase_0121: passcase_0122: failcase_0123: failcase_0124: failcase_0125: failcase_0126: failcase_0127: failcase_0128: failcase_0129: passcase_0130: passcase_0131: passcase_0132: failcase_0133: passcase_0134: failcase_0135: passcase_0136: failcase_0137: failcase_0138: failcase_0139: passcase_0140: passcase_0141: passcase_0142: passcase_0143: passcase_0144: failcase_0145: failcase_0146: passcase_0147: passcase_0148: passcase_0149: failcase_0150: passcase_0151: failcase_0152: failcase_0153: failcase_0154: failcase_0155: failcase_0156: failcase_0157: failcase_0158: passcase_0159: passcase_0160: failcase_0161: passcase_0162: failcase_0163: passcase_0164: failcase_0165: failcase_0166: failcase_0167: failcase_0168: passcase_0169: failcase_0170: failcase_0171: failcase_0172: failcase_0173: passcase_0174: failcase_0175: failcase_0176: failcase_0177: failcase_0178: failcase_0179: failcase_0180: failcase_0181: passcase_0182: failcase_0183: failcase_0184: failcase_0185: passcase_0186: failcase_0187: failcase_0188: failcase_0189: failcase_0190: failcase_0191: failcase_0192: failcase_0193: passcase_0194: passcase_0195: failcase_0196: failcase_0197: passcase_0198: failcase_0199: failcase_0200: failcase_0201: failcase_0202: passcase_0203: failcase_0204: passcase_0205: failcase_0206: failcase_0207: passcase_0208: failcase_0209: failcase_0210: failcase_0211: passcase_0212: failcase_0213: failcase_0214: failcase_0215: failcase_0216: failcase_0217: failcase_0218: failcase_0219: failcase_0220: failcase_0221: failcase_0222: passcase_0223: failcase_0224: failcase_0225: failcase_0226: failcase_0227: passcase_0228: failcase_0229: passcase_0230: passcase_0231: failcase_0232: failcase_0233: passcase_0234: failcase_0235: failcase_0236: failcase_0237: failcase_0238: failcase_0239: failcase_0240: failcase_0241: failcase_0242: passcase_0243: failcase_0244: failcase_0245: failcase_0246: failcase_0247: failcase_0248: failcase_0249: failcase_0250: failcase_0251: failcase_0252: failcase_0253: failcase_0254: passcase_0255: failcase_0256: failcase_0257: failcase_0258: failcase_0259: failcase_0260: passcase_0261: failcase_0262: passcase_0263: failcase_0264: failcase_0265: failcase_0266: failcase_0267: failcase_0268: passcase_0269: passcase_0270: failcase_0271: passcase_0272: failcase_0273: failcase_0274: failcase_0275: failcase_0276: failcase_0277: failcase_0278: passcase_0279: failcase_0280: failcase_0281: failcase_0282: passcase_0283: passcase_0284: failcase_0285: failcase_0286: failcase_0287: failcase_0288: failcase_0289: passcase_0290: passcase_0291: failcase_0292: passcase_0293: failcase_0294: passcase_0295: failcase_0296: failcase_0297: passcase_0298: failcase_0299: failcase_0300: failcase_0301: failcase_0302: passcase_0303: passcase_0304: failcase_0305: passcase_0306: failcase_0307: passcase_0308: passcase_0309: failcase_0310: failcase_0311: passcase_0312: failcase_0313: passcase_0314: failcase_0315: passcase_0316: passcase_0317: failcase_0318: failcase_0319: failcase_0320: failcase_0321: failcase_0322: failcase_0323: failcase_0324: failcase_0325: failcase_0326: failcase_0327: failcase_0328: failcase_0329: failcase_0330: passcase_0331: failcase_0332: passcase_0333: failcase_0334: failcase_0335: failcase_0336: failcase_0337: failcase_0338: passcase_0339: failcase_0340: failcase_0341: failcase_0342: passcase_0343: passcase_0344: failcase_0345: passcase_0346: failcase_0347: failcase_0348: failcase_0349: failcase_0350: failcase_0351: failcase_0352: failcase_0353: failcase_0354: failcase_0355: failcase_0356: failcase_0357: failcase_0358: failcase_0359: passcase_0360: failcase_0361: failcase_0362: failcase_0363: failcase_0364: failcase_0365: failcase_0366: failcase_0367: failcase_0368: failcase_0369: passcase_0370: passcase_0371: failcase_0372: passcase_0373: failcase_0374: passcase_0375: failcase_0376: failcase_0377: failcase_0378: failcase_0379: failcase_0380: failcase_0381: failcase_0382: passcase_0383: passcase_0384: failcase_0385: failcase_0386: failcase_0387: failcase_0388: failcase_0389: failcase_0390: failcase_0391: failcase_0392: passcase_0393: failcase_0394: failcase_0395: failcase_0396: failcase_0397: failcase_0398: failcase_0399: passcase_0400: failcase_0401: failcase_0402: failcase_0403: failcase_0404: failcase_0405: failcase_0406: failcase_0407: passcase_0408: passcase_0409: passcase_0410: failcase_0411: passcase_0412: failcase_0413: passcase_0414: passcase_0415: failcase_0416: failcase_0417: failcase_0418: failcase_0419: failcase_0420: passcase_0421: failcase_0422: failcase_0423: passcase_0424: failcase_0425: failcase_0426: failcase_0427: failcase_0428: passcase_0429: passcase_0430: passcase_0431: failcase_0432: passcase_0433: passcase_0434: passcase_0435: failcase_0436: failcase_0437: failcase_0438: failcase_0439: failcase_0440: failcase_0441: passcase_0442: failcase_0443: failcase_0444: failcase_0445: failcase_0446: passcase_0447: failcase_0448: failcase_0449: failcase_0450: failcase_0451: passcase_0452: failcase_0453: failcase_0454: failcase_0455: passcase_0456: failcase_0457: failcase_0458: failcase_0459: passcase_0460: passcase_0461: failcase_0462: failcase_0463: failcase_0464: failcase_0465: passcase_0466: failcase_0467: failcase_0468: failcase_0469: passcase_0470: passcase_0471: failcase_0472: failcase_0473: failcase_0474: failcase_0475: failcase_0476: passcase_0477: failcase_0478: failcase_0479: failcase_0480: failcase_0481: failcase_0482: failcase_0483: passcase_0484: failcase_0485: passcase_0486: failcase_0487: failcase_0488: failcase_0489: failcase_0490: failcase_0491: failcase_0492: passcase_0493: failcase_0494: passcase_0495: failcase_0496: failcase_0497: failcase_0498: passcase_0499: failcase_0500: passcase_0501: failcase_0502: failcase_0503: failcase_0504: passcase_0505: failcase_0506: failcase_0507: failcase_0508: failcase_0509: failcase_0510: failcase_0511: passcase_0512: failcase_0513: passcase_0514: failcase_0515: failcase_0516: failcase_0517: failcase_0518: passcase_0519: passcase_0520: failcase_0521: failcase_0522: passcase_0523: failcase_0524: passcase_0525: passcase_0526: failcase_0527: failcase_0528: passcase_0529: failcase_0530: failcase_0531: failcase_0532: failcase_0533: failcase_0534: passcase_0535: failcase_0536: failcase_0537: failcase_0538: passcase_0539: failcase_0540: failcase_0541: failcase_0542: passcase_0543: failcase_0544: failcase_0545: failcase_0546: failcase_0547: failcase_0548: failcase_0549: failcase_0550: failcase_0551: failcase_0552: passcase_0553: failcase_0554: failcase_0555: failcase_0556: failcase_0557: failcase_0558: failcase_0559: passcase_0560: failcase_0561: failcase_0562: failcase_0563: passcase_0564: failcase_0565: failcase_0566: failcase_0567: failcase_0568: failcase_0569: passcase_0570: passcase_0571: failcase_0572: passcase_0573: failcase_0574: passcase_0575: passcase_0576: failcase_0577: failcase_0578: failcase_0579: failcase_0580: failcase_0581: passcase_0582: passcase_0583: passcase_0584: failcase_0585: failcase_0586: failcase_0587: failcase_0588: failcase_0589: passcase_0590: passcase_0591: failcase_0592: failcase_0593: failcase_0594: failcase_0595: failcase_0596: passcase_0597: failcase_0598: failcase_0599: failcase_0600: passcase_0601: failcase_0602: passcase_0603: failcase_0604: failcase_0605: failcase_0606: failcase_0607: passcase_0608: failcase_0609: failcase_0610: failcase_0611: failcase_0612: failcase_0613: passcase_0614: failcase_0615: passcase_0616: passcase_0617: failcase_0618: failcase_0619: failcase_0620: failcase_0621: passcase_0622: failcase_0623: failcase_0624: failcase_0625: failcase_0626: failcase_0627: failcase_0628: passcase_0629: failcase_0630: failcase_0631: passcase_0632: failcase_0633: failcase_0634: passcase_0635: failcase_0636: failcase_0637: failcase_0638: failcase_0639: failcase_0640: failcase_0641: failcase_0642: failcase_0643: failcase_0644: failcase_0645: failcase_0646: passcase_0647: passcase_0648: failcase_0649: failcase_0650: passcase_0651: failcase_0652: failcase_0653: failcase_0654: failcase_0655: failcase_0656: passcase_0657: failcase_0658: failcase_0659: failcase_0660: passcase_0661: failcase_0662: failcase_0663: failcase_0664: failcase_0665: failcase_0666: failcase_0667: failcase_0668: failcase_0669: failcase_0670: passcase_0671: failcase_0672: failcase_0673: failcase_0674: failcase_0675: failcase_0676: failcase_0677: passcase_0678: failcase_0679: failcase_0680: failcase_0681: passcase_0682: failcase_0683: failcase_0684: failcase_0685: failcase_0686: failcase_0687: failcase_0688: failcase_0689: passcase_0690: passcase_0691: failcase_0692: passcase_0693: failcase_0694: failcase_0695: failcase_0696: failcase_0697: failcase_0698: failcase_0699: failcase_0700: failcase_0701: failcase_0702: passcase_0703: failcase_0704: failcase_0705: passcase_0706: failcase_0707: passcase_0708: passcase_0709: passcase_0710: passcase_0711: passcase_0712: failcase_0713: passcase_0714: failcase_0715: passcase_0716: failcase_0717: failcase_0718: passcase_0719: failcase_0720: failcase_0721: passcase_0722: failcase_0723: failcase_0724: passcase_0725: failcase_0726: passcase_0727: failcase_0728: failcase_0729: failcase_0730: passcase_0731: failcase_0732: failcase_0733: passcase_0734: failcase_0735: failcase_0736: failcase_0737: passcase_0738: passcase_0739: passcase_0740: failcase_0741: failcase_0742: failcase_0743: failcase_0744: failcase_0745: passcase_0746: failcase_0747: passcase_0748: failcase_0749: failcase_0750: failcase_0751: failcase_0752: failcase_0753: failcase_0754: failcase_0755: failcase_0756: failcase_0757: passcase_0758: failcase_0759: failcase_0760: passcase_0761: failcase_0762: failcase_0763: failcase_0764: failcase_0765: failcase_0766: passcase_0767: passcase_0768: failcase_0769: failcase_0770: failcase_0771: failcase_0772: failcase_0773: failcase_0774: failcase_0775: failcase_0776: failcase_0777: failcase_0778: failcase_0779: failcase_0780: failcase_0781: failcase_0782: failcase_0783: passcase_0784: failcase_0785: passcase_0786: failcase_0787: failcase_0788: passcase_0789: failcase_0790: failcase_0791: failcase_0792: failcase_0793: failcase_0794: failcase_0795: failcase_0796: failcase_0797: passcase_0798: failcase_0799: failcase_0800: passcase_0801: failcase_0802: failcase_0803: failcase_0804: failcase_0805: passcase_0806: failcase_0807: passcase_0808: failcase_0809: passcase_0810: passcase_0811: failcase_0812: failcase_0813: failcase_0814: failcase_0815: failcase_0816: failcase_0817: failcase_0818: failcase_0819: failcase_0820: passcase_0821: failcase_0822: failcase_0823: failcase_0824: failcase_0825: failcase_0826: failcase_0827: failcase_0828: failcase_0829: passcase_0830: failcase_0831: failcase_0832: failcase_0833: failcase_0834: failcase_0835: passcase_0836: failcase_0837: passcase_0838: failcase_0839: failcase_0840: failcase_0841: failcase_0842: passcase_0843: passcase_0844: failcase_0845: failcase_0846: failcase_0847: failcase_0848: failcase_0849: failcase_0850: failcase_0851: failcase_0852: failcase_0853: failcase_0854: failcase_0855: passcase_0856: failcase_0857: failcase_0858: failcase_0859: failcase_0860: failcase_0861: failcase_0862: failcase_0863: failcase_0864: failcase_0865: failcase_0866: failcase_0867: failcase_0868: failcase_0869: failcase_0870: failcase_0871: failcase_0872: failcase_0873: failcase_0874: passcase_0875: failcase_0876: failcase_0877: passcase_0878: failcase_0879: failcase_0880: failcase_0881: passcase_0882: failcase_0883: failcase_0884: failcase_0885: failcase_0886: failcase_0887: failcase_0888: failcase_0889: failcase_0890: passcase_0891: failcase_0892: failcase_0893: passcase_0894: failcase_0895: failcase_0896: failcase_0897: passcase_0898: failcase_0899: failcase_0900: failcase_0901: failcase_0902: failcase_0903: failcase_0904: failcase_0905: passcase_0906: failcase_0907: failcase_0908: passcase_0909: failcase_0910: passcase_0911: failcase_0912: failcase_0913: failcase_0914: failcase_0915: failcase_0916: failcase_0917: failcase_0918: failcase_0919: failcase_0920: passcase_0921: passcase_0922: passcase_0923: passcase_0924: failcase_0925: failcase_0926: failcase_0927: failcase_0928: failcase_0929: failcase_0930: failcase_0931: failcase_0932: failcase_0933: failcase_0934: failcase_0935: failcase_0936: failcase_0937: failcase_0938: failcase_0939: failcase_0940: failcase_0941: passcase_0942: passcase_0943: failcase_0944: failcase_0945: failcase_0946: failcase_0947: passcase_0948: passcase_0949: passcase_0950: failcase_0951: failcase_0952: failcase_0953: passcase_0954: failcase_0955: failcase_0956: passcase_0957: failcase_0958: passcase_0959: failcase_0960: passcase_0961: failcase_0962: failcase_0963: failcase_0964: failcase_0965: passcase_0966: failcase_0967: passcase_0968: passcase_0969: failcase_0970: failcase_0971: passcase_0972: failcase_0973: passcase_0974: passcase_0975: passcase_0976: failcase_0977: failcase_0978: passcase_0979: failcase_0980: failcase_0981: passcase_0982: failcase_0983: failcase_0984: failcase_0985: failcase_0986: passcase_0987: failcase_0988: failcase_0989: failcase_0990: failcase_0991: failcase_0992: failcase_0993: failcase_0994: failcase_0995: failcase_0996: failcase_0997: failcase_0998: failcase_0999: failcase_1000: failcase_1001: passcase_1002: failcase_1003: failcase_1004: passcase_1005: failcase_1006: failcase_1007: failcase_1008: passcase_1009: failcase_1010: failcase_1011: passcase_1012: failcase_1013: failcase_1014: failcase_1015: failcase_1016: passcase_1017: passcase_1018: failcase_1019: failcase_1020: passcase_1021: failcase_1022: failcase_1023: failcase_1024: failcase_1025: failcase_1026: failcase_1027: failcase_1028: failcase_1029: failcase_1030: passcase_1031: failcase_1032: passcase_1033: failcase_1034: passcase_1035: failcase_1036: failcase_1037: failcase_1038: failcase_1039: failcase_1040: passcase_1041: failcase_1042: failcase_1043: failcase_1044: failcase_1045: failcase_1046: failcase_1047: failcase_1048: failcase_1049: failcase_1050: failcase_1051: passcase_1052: failcase_1053: passcase_1054: passcase_1055: failcase_1056: failcase_1057: failcase_1058: passcase_1059: failcase_1060: failcase_1061: failcase_1062: failcase_1063: failcase_1064: failcase_1065: passcase_1066: passcase_1067: failcase_1068: failcase_1069: passcase_1070: failcase_1071: failcase_1072: passcase_1073: failcase_1074: failcase_1075: passcase_1076: failcase_1077: failcase_1078: passcase_1079: failcase_1080: failcase_1081: passcase_1082: passcase_1083: failcase_1084: failcase_1085: failcase_1086: failcase_1087: failcase_1088: failcase_1089: failcase_1090: failcase_1091: failcase_1092: failcase_1093: failcase_1094: passcase_1095: failcase_1096: failcase_1097: failcase_1098: failcase_1099: passcase_1100: failcase_1101: failcase_1102: passcase_1103: failcase_1104: failcase_1105: failcase_1106: failcase_1107: passcase_1108: failcase_1109: passcase_1110: failcase_1111: failcase_1112: failcase_1113: failcase_1114: failcase_1115: failcase_1116: failcase_1117: passcase_1118: failcase_1119: failcase_1120: passcase_1121: passcase_1122: failcase_1123: failcase_1124: failcase_1125: failcase_1126: failcase_1127: failcase_1128: failcase_1129: passcase_1130: failcase_1131: failcase_1132: failcase_1133: failcase_1134: failcase_1135: failcase_1136: failcase_1137: failcase_1138: failcase_1139: failcase_1140: failcase_1141: failcase_1142: failcase_1143: passcase_1144: failcase_1145: passcase_1146: failcase_1147: failcase_1148: passcase_1149: passcase_1150: failcase_1151: passcase_1152: failcase_1153: failcase_1154: passcase_1155: failcase_1156: passcase_1157: passcase_1158: failcase_1159: failcase_1160: failcase_1161: failcase_1162: passcase_1163: passcase_1164: failcase_1165: failcase_1166: failcase_1167: failcase_1168: passcase_1169: passcase_1170: failcase_1171: passcase_1172: failcase_1173: passcase_1174: failcase_1175: failcase_1176: failcase_1177: failcase_1178: failcase_1179: failcase_1180: failcase_1181: failcase_1182: failcase_1183: passcase_1184: failcase_1185: failcase_1186: passcase_1187: failcase_1188: passcase_1189: failcase_1190: failcase_1191: failcase_1192: failcase_1193: failcase_1194: failcase_1195: failcase_1196: failcase_1197: failcase_1198: failcase_1199: failcase_1200: passcase_1201: failcase_1202: failcase_1203: failcase_1204: failcase_1205: failcase_1206: failcase_1207: failcase_1208: failcase_1209: passcase_1210: failcase_1211: passcase_1212: failcase_1213: failcase_1214: passcase_1215: failcase_1216: failcase_1217: failcase_1218: failcase_1219: failcase_1220: failcase_1221: failcase_1222: passcase_1223: failcase_1224: passcase_1225: failcase_1226: failcase_1227: failcase_1228: failcase_1229: failcase_1230: failcase_1231: failcase_1232: passcase_1233: failcase_1234: failcase_1235: passcase_1236: passcase_1237: failcase_1238: failcase_1239: passcase_1240: failcase_1241: failcase_1242: failcase_1243: passcase_1244: failcase_1245: passcase_1246: passcase_1247: failcase_1248: failcase_1249: failcase_1250: failcase_1251: failcase_1252: passcase_1253: failcase_1254: failcase_1255: failcase_1256: failcase_1257: passcase_1258: failcase_1259: failcase_1260: failcase_1261: failcase_1262: failcase_1263: passcase_1264: passcase_1265: failcase_1266: passcase_1267: passcase_1268: failcase_1269: failcase_1270: failcase_1271: failcase_1272: failcase_1273: failcase_1274: failcase_1275: failcase_1276: passcase_1277: passcase_1278: failcase_1279: passcase_1280: failcase_1281: failcase_1282: failcase_1283: passcase_1284: passcase_1285: passcase_1286: failcase_1287: failcase_1288: failcase_1289: failcase_1290: failcase_1291: passcase_1292: passcase_1293: passcase_1294: passcase_1295: passcase_1296: failcase_1297: passcase_1298: failcase_1299: failcase_1300: passcase_1301: failcase_1302: failcase_1303: failcase_1304: failcase_1305: failcase_1306: failcase_1307: failcase_1308: failcase_1309: failcase_1310: failcase_1311: passcase_1312: failcase_1313: failcase_1314: passcase_1315: passcase_1316: passcase_1317: failcase_1318: failcase_1319: passcase_1320: failcase_1321: passcase_1322: failcase_1323: failcase_1324: failcase_1325: passcase_1326: failcase_1327: failcase_1328: failcase_1329: failcase_1330: passcase_1331: passcase_1332: failcase_1333: failcase_1334: failcase_1335: failcase_1336: failcase_1337: passcase_1338: failcase_1339: passcase_1340: failcase_1341: passcase_1342: failcase_1343: failcase_1344: passcase_1345: failcase_1346: failcase_1347: passcase_1348: failcase_1349: passcase_1350: failcase_1351: passcase_1352: failcase_1353: failcase_1354: failcase_1355: passcase_1356: passcase_1357: failcase_1358: failcase_1359: failcase_1360: failcase_1361: failcase_1362: failcase_1363: failcase_1364: passcase_1365: passcase_1366: failcase_1367: failcase_1368: failcase_1369: failcase_1370: passcase_1371: failcase_1372: failcase_1373: failcase_1374: failcase_1375: failcase_1376: failcase_1377: failcase_1378: failcase_1379: failcase_1380: failcase_1381: failcase_1382: failcase_1383: passcase_1384: passcase_1385: failcase_1386: failcase_1387: passcase_1388: failcase_1389: passcase_1390: passcase_1391: passcase_1392: failcase_1393: failcase_1394: failcase_1395: failcase_1396: failcase_1397: passcase_1398: failcase_1399: passcase_1400: failcase_1401: failcase_1402: failcase_1403: passcase_1404: passcase_1405: failcase_1406: failcase_1407: passcase_1408: failcase_1409: failcase_1410: failcase_1411: passcase_1412: passcase_1413: passcase_1414: failcase_1415: failcase_1416: failcase_1417: failcase_1418: failcase_1419: failcase_1420: failcase_1421: failcase_1422: failcase_1423: passcase_1424: failcase_1425: failcase_1426: failcase_1427: failcase_1428: failcase_1429: failcase_1430: failcase_1431: passcase_1432: passcase_1433: passcase_1434: failcase_1435: failcase_1436: passcase_1437: passcase_1438: failcase_1439: passcase_1440: failcase_1441: failcase_1442: failcase_1443: failcase_1444: failcase_1445: failcase_1446: failcase_1447: failcase_1448: passcase_1449: failcase_1450: passcase_1451: failcase_1452: failcase_1453: failcase_1454: passcase_1455: failcase_1456: failcase_1457: passcase_1458: failcase_1459: failcase_1460: passcase_1461: failcase_1462: failcase_1463: failcase_1464: passcase_1465: passcase_1466: failcase_1467: failcase_1468: failcase_1469: failcase_1470: passcase_1471: passcase_1472: failcase_1473: failcase_1474: passcase_1475: failcase_1476: failcase_1477: failcase_1478: failcase_1479: failcase_1480: passcase_1481: passcase_1482: failcase_1483: failcase_1484: failcase_1485: failcase_1486: failcase_1487: failcase_1488: failcase_1489: failcase_1490: failcase_1491: passcase_1492: failcase_1493: failcase_1494: passcase_1495: failcase_1496: failcase_1497: failcase_1498: failcase_1499: passcase_1500: fail
per-case results · all 1500, in case_id order
discuss this task →