this post was submitted on 01 Sep 2024
928 points (98.2% liked)

Programmer Humor

32042 readers
910 users here now

Post funny things about programming here! (Or just rant about your favourite programming language.)

Rules:

founded 5 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] residentmarchant 9 points 2 weeks ago (2 children)

Are you like building a mobile app or have 100k tests or is it just super slow?

[–] [email protected] 12 points 2 weeks ago

Still waiting on approval for more resources. It's not a priority in the company.

I swear we have like 4 runners on a raspberry pi.

[–] thebestaquaman 2 points 2 weeks ago

My test suite takes quite a bit of time, not because the code base is huge, but because it consists of a variety of mathematical models that should work under a range of conditions.

This makes it very quick to write a test that's basically "check that every pair of models gives the same output for the same conditions" or "check that re-ordering the inputs in a certain way does not change the output".

If you have 10 models, with three inputs that can be ordered 6 ways, you now suddenly have 60 tests that take maybe 2-3 sec each.

Scaling up: It becomes very easy to write automated testing for a lot of stuff, so even if each individual test is relatively quick, they suddenly take 10-15 min to run total.

The test suite now is ≈2000 unit/integration tests, and I have experienced uncovering an obscure bug because a single one of them failed.