Load from ground-truth from /Users/vodkaexpans/Library/Caches/evalplus/fe585eb4df8c88d844eeb463ea4d0302.pkl
Reading samples...


humaneval (base tests)
pass@1:	0.963
humaneval+ (base + extra tests)
pass@1:	0.927