Questions tagged [testing]

Verifying the behavior of a software system against the expected behavior of that system.

1470 questions
51
votes
11 answers

How is software used in critical life-or-death systems tested?

An airplane, as opposed to, for example, a website, is a system where any failure in certain systems is completely unacceptable, since errors in e.g. flight monitoring can cause the autopilot to malfunction and do a dive. Obviously, this doesn't…
waiwai933
  • 733
45
votes
14 answers

How to get better at testing your own code

I am a relatively new software developer, and one of the things I think I should improve is my ability to test my own code. Whenever I develop a new functionality, I find it really difficult to follow all the possible paths so I can find bugs. I…
35
votes
10 answers

Should developers be responsible for tests other than unit tests, if so which ones are the most common?

I am currently working on a rather large project, and I have used JUnit and EasyMock to fairly extensively unit test functionality. I am now interested in what other types of testing I should worry about. As a developer is it my responsibility to…
Jackie
  • 550
24
votes
7 answers

How to get flaky tests fixed after having mitigated their flakiness

Recently, I was charged with making about 9000 Selenium tests start running in CI/CD nightly. These tests had built up over about 8 years and had up until then been run in an ad hoc way. It was important that failures in the CI/CD be genuine…
22
votes
5 answers

Why use in-memory database for integration testing?

I'm really confused when I see a lot of in-memory database implementation used for testing, because I also heard a lot from integration testing best practices that the environment running the test should resemble as closely as possible the…
dnang
  • 585
20
votes
4 answers

How to structure tests where one test is another test's setup?

I'm integration testing a system, by using only the public APIs. I have a test that looks something like this: def testAllTheThings(): email = create_random_email() password = create_random_password() ok = account_signup(email, password) …
Roger Lipscombe
  • 391
  • 2
  • 9
17
votes
7 answers

Are testers considered low profile?

I happened to know some system admin and according to him, testing guys are not given preferences in an organization in comparison to developers. No doubt software releases are not possible without testers but I've never laid my hands on testing so…
Ayush Goyal
  • 1,173
16
votes
10 answers

Black box or white box testing - which do you do first?

On a very small team, where the black box and white box testing is done by the same person, which should the tester do first?
10
votes
8 answers

Functional testing must be done by external party to avoid bias?

Our developers demand that someone external to the development team completes the functional testing. Their argument is that they are biased and cannot test their own code as they are too close to it. Our last round of testing is with the client in…
bobbyz
9
votes
16 answers

Bugs vs. Nonexistent Features

Is it fair to refer to a feature that has not yet been coded as a "bug"? For example, I am working on a project that involves three distinct features. If I only start one of them, is it correct to refer to the other two as bugs? Or do bugs only…
9
votes
1 answer

How was the first Malbolge interpreter tested?

According to Wikipedia, Malbolge was so difficult to understand when it arrived that it took two years for the first Malbolge program to appear. If this is true, how was the first Malbolge interpreter tested (to check if it did the right thing when…
user4595
8
votes
4 answers

Do testers have to look at source code?

How necessary is it for testers to do white-box testing in addition to black-box testing? As a developer, I see value in having a QA-minded person go through my code and look for weak points, but it also seems like if a non-technical tester is…
8
votes
5 answers

Property based testing without reimplementing the code under test

Given a very simple method such as: def squaredDistance(p1: Point, p2: Point) = math.pow(p1.lon - p2.lon, 2.0) + math.pow(p1.lat - p2.lat, 2.0) What are some valuable property-based tests that don't simply reimplement the method? I can only…
Synesso
  • 574
  • 4
  • 11
7
votes
2 answers

How Do You Test Your Software?

I'm currently working on 2 software projects: A Social Networking Web Site for an NGO A Patient Management System for a hospital Although I've been programming for 5 years, I can't just say that I'm very good at testing or Test Driven Designing an…
Kubi
  • 171
  • 4
7
votes
1 answer

How to test calculations that are only passed down into the stack rather than returned upward

This is a problem I have been trying to wrap my head around a couple months now. It has shown up again in a learning project I was working on last night, so I will use that as an example. I am building an entity-component system, and have a…
1
2 3 4 5 6