Blog / tag4 entries
testing
Every preloop note filed under testing.
4 min
How preloop decides which tests to skip
preloop skips a test only when its detected inputs are complete, unchanged, and safe to trust.
preloop engineering3 minDeciding which state to explore next in property testing
Property testing gives you an oracle. The hard part is choosing the next action, and a model-guided explorer found the right one about 3x more often than random.
preloop engineering3 minThe models I daily-drive for CI repair
On CI-bench, the models on the cost frontier are also the cheapest. For CI repair, reliability per dollar beats the largest model.
preloop engineering5 minCI-bench: how good are agents at diagnosing and fixing CI failures?
We ran 80 real CI failures through nine agent configurations, three times each. First-attempt scores hid real differences in reliability.
preloop engineering