170

Simple enough question: What math should all game programmers have a firm grasp of in order to be successful?

I'm not specifically talking about rendering math or anything in the niche areas of game programming, more specifically just things that even game programmers should know about, and if they don't they'll probably find it useful.

Note: as there is no one correct answer, this question (and its answers) is a community wiki.

Also, if you would like fancy latex math equations, feel free to use http://mathurl.com/.

Tetrad
  • 30,124
  • 12
  • 94
  • 143
  • 1
    mmm i think there was a topic talking about math books every programmer should read or something like that i dont really recall it ... but it had some nice things on it.... not sure if it was here or stackoverflow aswell lol – Prix Aug 02 '10 at 19:14
  • @Prix: you mean this one: http://gamedev.stackexchange.com/questions/1210/good-3d-math-theory-books ;) – Michael Klement Aug 03 '10 at 10:15
  • Any 3D graphics development requires a decent understanding of linear algebra. Vector math tutorial for 3D Computer Graphics is by far the best resource for learning vectors and matrices. It is also interactive that each section has a test question to verify and seal the understanding of that topic. – legends2k Oct 26 '13 at 05:44
  • The PNPOLY algorithm: http://www.ecse.rpi.edu/Homepages/wrf/Research/Short_Notes/pnpoly.html – coderanger Aug 02 '10 at 19:40

13 Answers13

141

There are many other forms of math that are useful, but at the absolute minimum you need to know these:

  • Algebra and Arithmetic

These are pretty basic, but if you don't know these you won't have a chance at even being a programmer let alone a game developer.

Objects in a game world are represented with vectors. A vector represents things like an object's position, look direction and speed. Vector math calculations such as the Dot Product, Cross Product, and Vector normalisation are essential.

How do I move my game object? The novice might say:

"I know! I'll just do:" object.position.x++.

No no no. You need to use a vector calculation. The object needs a position, direction and acceleration vector which you can use to move the object. If you do the novice thing, you'll get stuck in an unmaintainable mess, and how do you make it move in a direction not aligned with the world's XYZ axis?

Main reason games use quaternions is because they represent rotations almost as space-efficiently as Euler angles, without suffering from Gimbal lock. Gimbal Lock begins when any Euler angle reaches a rotation of 90 degrees around any axis: you immediately lose a degree of freedom. Quaternions address this issue by adding a fourth dimension. If you stuck with Euler angles, you'd have to restrict one axis to never rotating more than ~89 degrees.

If you are going to be programming the math for physics responses in a game, then taking a physics class wouldn't have been a bad idea.

Reasons why you will need to know physics equations:

  1. Making a ball bounce (see: co-efficient of restitution)
  2. Make a ball move in a direction with 'x' newtons of force
  3. Make something have more or less friction so it will slide at a different speed
  4. Collision responses: What direction will the object rotate when I hit it 'here'?

If you use a physics engine (or a game engine which has the physics engine inbuilt) then you can get away with knowing very little about physics. Still, it's quite good to know when you need to get your hands dirty because the physics engine isn't performing properly.

Community
  • 1
Brock Woolf
  • 101
  • 1
  • 1
  • 5
  • 3
    For physics, Chris Hecker's articles on rigid body dynamics, including collision response and restitution, are marvellous: http://chrishecker.com/Rigid_Body_Dynamics – tenpn Aug 03 '10 at 10:14
  • 28
    You mentioned quaternions but not transformation matrices?? – Andrew Russell Aug 05 '10 at 04:06
  • 11
    "Gimble [sic] lock is that effect where when you move your mouse to look down, it will stop when you look directly down...." Actually that is usually done for player sanity, and has nothing to do with gimbal lock. –  Aug 09 '10 at 18:56
  • 5
    It amazes me just how often quaternions are linked to gimble lock. I've written 3D games with no quaternions whatsoever and never had a gimble lock problem. If you really understand 3D maths and know what a gimble lock actually is, then you won't have that problem. – Skizz Sep 09 '10 at 17:34
  • 12
    Gimbal lock is actually caused by naive rotation with Euler angles (commonly Tait–Bryan angles: Yaw, Pitch, Roll). Alternative representations like Axis-Angle can also be used to prevent its occurrence. Quaternions however have the benefit of easy interpolation, and are generally preferred for that reason. – Jason Kozak Sep 15 '10 at 15:49
  • If you are going to be writing a physics engine then much more than a physics class is going to be needed, you are going to need to know numerical methods. – stonemetal Jan 07 '11 at 21:49
  • 1
    You don't actually need quaternions to avoid gimbal lock. If you build a rotation matrix using Right, Forward, Up vectors (view it as a change of basis) then you won't ever experience gimbal lock. Gimbal lock happens only when you use Euler angles. – bobobobo Jul 24 '12 at 17:58
  • 1
    If used wrong (e.g. rotation recalculated from euler angles each frame), quaternions don't make a difference. But if used right (storing the orientation and adding/multiplying a rotational delta quaternion calculated from e.g. an axis and angle) they make life much easier, e.g interpolating between matrices is not as easy as slerping a quat and lerping a translation vector (and, maybe, a vector/scalar for scale). – Exilyth Mar 23 '13 at 19:01
  • 1
    I would add Game Theory to this answer. When designing game mechanics it's important to evauluate equilibria and stability in order to make it more balanced and therefore more long-lived. If you think about additive famous games (expecially browser games and strategy games) you'll realize that they rely on some mechanics and without thinking about it the game will get boring soon. – HAL9000 Feb 02 '14 at 13:20
54

I dream of the day when game development is as data driven as art production. I don't see it anywhere on the horizon so for now knowing some math appears to be a necessity.

Math is like technique, the more the better, as long as you can apply it.

Here is the order of importance I see.

  • Arithmetic
  • Linear Algebra (with geometric interpretations)
  • Calculus (physics)
  • Combinatorics (randomized levels)
  • Probability (balancing)
  • Statistics (Bayesian esp. for AI)

I could keep going. The more you know the better, but learning a bunch of math doesn't mean you will make a great game, but it can help.

Jonathan Fischoff
  • 1,148
  • 9
  • 14
  • 5
    Calculus is a huge field. Probably only a small amount of it is needed for game development. – Noldorin Aug 04 '10 at 08:05
  • 2
    @Noldorin yep. In most situations understanding the relationship between the derivative, acceleration, velocity, and position might be enough...but calculus is awesome. – Jonathan Fischoff Aug 04 '10 at 08:16
  • Bayesian AIs tend to be unused for games because of comparatively large memory usage, poor debuggability and predictability, and a well-defined problem space. A good implementation of classic search with clever heuristics is usually (but not always) a better tool. –  Aug 08 '10 at 19:56
  • 1
    To me its not a particular Bayesian algorithm that I find important, but understanding the reasoning process as espoused by E. T. Jaynes. I don't think is anything inherently slow about Bayesian reasoning. – Jonathan Fischoff Aug 08 '10 at 20:18
  • @Jonathan: Agreed, that and numerical integration methods should be sufficient for most things. – Noldorin Aug 17 '10 at 13:45
  • 1
    Statistics are wonderful when you're developing an AI, or just generally developing a management/tycoon game. On the other hand, I have no familiarity with calculus at all. I'd argue statistics and probability are essentially the same thing for learning purposes as the field of statistics stems from work on probability. It's very subjective. – Rushyo Sep 10 '10 at 11:34
26

A very basic one is the Pythagorean theorem. Also known as the distance formula.

a^2+b^2=c^2 where a and b are the edges of a right triangle and c is the hypotenuse. This means that in order to find the length of a vector, you do this:

distance = sqrt( a^2 + b^2 )

Another note of interest is that if you're just comparing distances, you don't have to take the square root (which can be relatively costly). That's why most frameworks have a "distance squared" or "length squared" function for their vectors.

Glorfindel
  • 986
  • 1
  • 9
  • 16
Tetrad
  • 30,124
  • 12
  • 94
  • 143
  • 1
    I'm pretty sure I've read this somewhere else on this site before :) – Ricket Aug 02 '10 at 19:08
  • 1
    Sure, this post was inspired by that thread/comment. – Tetrad Aug 02 '10 at 19:16
  • I'm getting some déjà vu here... :) – mmyers Aug 02 '10 at 22:14
  • 2
    More generally, the length of a vector is the square root of the dot product with itself. So, sqrt(V dot V) is its length. So, the distance between two points is: sqrt((A-B) dot (A-B)) – greyfade Aug 03 '10 at 05:08
  • Also great is understanding it in the context of the trig identity sin²(x) + cos²(x) = 1. –  Aug 08 '10 at 09:29
  • Is there a reason why you used http rather than HTTPS when inserting the mathurl links? This is creatingb issues with the adroid app rendering the description,instead of the image you link – Ferrybig Mar 03 '18 at 17:58
21
  • Vectors both 3D and 4D, and what the W component should be set to
  • Left-hand and right-hand coordinate systems, and which one your game is
  • The dot product, and what it's useful for
  • The cross product, and what it's useful for
  • Matrices, how they represent orientation and position and how you can combine them
  • Quaternions

Even if you're not The Graphics Guy, you're going to use vectors and vector maths 80% of the time. They're the onions of our fun bolognese.

tenpn
  • 5,524
  • 3
  • 32
  • 45
12

A firm grasp of +, -, *, and /. Without them, you're completely screwed.

Fernando Silveira
  • 101
  • 4
PrettyPrincessKitty FS
  • 10,315
  • 8
  • 43
  • 68
  • 14
    I think we can all agree this isn't what the question was asking. (also you forgot %). – coderanger Aug 02 '10 at 21:07
  • 2
    Other answers get voted up for this (basic arithmetic).... – RCIX Aug 03 '10 at 01:21
  • 9
    Not just basic arithmetic, but understanding how the operations all work in twos-complement, fixed point, and IEEE floating point environments. Without a firm grasp on why 0.1 * 3 != 0.3, or why -x might not be what you expect, you are screwed. –  Aug 07 '10 at 23:15
11

Yeah, game programming tends to be pretty math-intensive. What math you need depends on what you're working on. Basic arithmetic is a must, of course, just as it is in all programming. Beyond that:

Geometry is vital to any graphics work. If you want to display things on screen, you need to understand coordinate systems. And if you want to move them around in anything but the cardinal directions, you'll be completely lost without a solid grasp of sines, cosines and vectors (basic trig). And if you need to work in 3D, the geometry and trig requirements get a lot more complicated.

If you want to model any sort of remotely realistic physics, you need calculus for that. (It's what drove Newton to invent calculus, afterall.)

Any sort of probability calculations require knowledge of statistics and probability theory in order to get sane results without insane amounts of trial and error.

There's probably a lot more, but that's what comes to mind just off the top of my head.

Mason Wheeler
  • 1,168
  • 10
  • 25
  • I remember when my little brother tried to make a Bang-Bang game as a project for his high school VB class. He had everything worked out, except he had no idea how to make the cannonballs fly in an arc based on angle and power, because he hadn't taken Trig 1 yet. After I explained the basics, it worked just fine. – Mason Wheeler Aug 03 '10 at 22:17
  • No Trig needed for the arc, just use s=u.t + a.t.t/2. You need trig to get the initial velocity though (u). – Skizz Sep 09 '10 at 17:26
  • 1
    Why isn't this higher? Half the programmers I've worked with can't use sines and cosines for the life of them. – zaratustra Sep 09 '10 at 22:00
  • @Skizz: Yeah. You need trig to turn an angle and a power into an initial vector. After that you just need an animation loop and a gravitic constant. – Mason Wheeler Sep 10 '10 at 04:43
10

Binary and Hexadecimal numbering systems, and how to convert them to/from decimal numbers.

Although you won't generally need to work with raw Binary numbers, they are frequently used for Flag variables, which require boolean logic and bit-shifting.

Hex isn't quite as important (unless you want to process 0xDEADBEEF), but at a minimum, you'd want to recognize when they're being used, and why.

Cyclops
  • 3,129
  • 3
  • 32
  • 39
  • 1
    If you can't read hex, you can't effectively program. Most bitwise constants in C and C++ are going to be specified as hex values. –  Aug 07 '10 at 23:16
  • I think you've got Boolean and binary mixed up. Not sure they're absolutely necessary for game programming. – Skizz Sep 09 '10 at 17:22
  • @Skizz, good point - fixed. (And another minor point, it is a wiki - nothing stopping you from changing it. :) – Cyclops Sep 09 '10 at 21:23
  • If you can't read hex, then use a tool to convert it for you. – Thomas Eding Apr 25 '14 at 21:59
9

At the very least you'll need.

  • Algebra
  • Basic Geometry
  • Basic Trigonometry

You'll also want to have at least a working knowledge of Vector operations, and you'll want to know what a Matrix is and what it can be used for, although the details won't be strictly necessary.

If you'd like to get into graphics programming you'll need a hell of a lot more math knowledge, but doing general gameplay programming does not have to be so math intensive.

jessecurry
  • 233
  • 2
  • 6
7

I think the payoff matrix is a pretty essential tool. Games are often more fun when they approach some interesting zero-sum fair play balance, and payoff matrices help you quantify that in complicated cases. I guess this wikipedia article is as good as any, and gets the basic necessary concept across: http://en.wikipedia.org/wiki/Normal-form_game

Kzqai
  • 1,188
  • 1
  • 13
  • 28
  • This appears extremely impractical to me. Do you think Starcraft or Warcraft 3 were balanced using a method like this? I don't think so, I believe it was iteration and playtesting, and constant patching. – bobobobo Jan 09 '13 at 02:54
  • 1
    Uh, they almost certainly were, the initial warcraft armies were modified duplicates of each-other that were probably created with payoff matrices designed to make them balanced overall. After that they may have simply built upon what they learned to tune things, but they probably had to do it again with starcraft to gets some reasonable level of balance now that three different armies were involved, and again when starcraft II units were added. Obviously you don't simply stop at the model, playtesting often shows emergent properties, but a payoff matrix is how you initially model complexity. – Kzqai Jan 09 '13 at 21:43
  • [citation needed]? – bobobobo Jan 09 '13 at 22:04
  • 1
    It was this: http://www.amazon.com/Game-Architecture-Design-New-Edition/dp/0735713634/ref=pd_sim_b_1 I wish that amazon version enabled searching inside the book, because it might be a great thing to reference in bits for this site. Though maybe the amazon in-book search doesn't work that way. Anyway, that's where they went over payoff-matrices, using warcraft as an example, and the advantage for managing complexity was so clear it made me an instant convert. That's no guarantee that Blizzard actually used that approach, but they're smart guys, so they probably had a mathematical solution... – Kzqai Jan 10 '13 at 23:46
  • ... at least for a way of being able to understand the balance at a glance. Obviously you want to add testing to that as well. I actually bought the book on the strength of a smaller, cut down pamphlet that had awesome game related content, including discussion of the payoff matrix and rock-paper-scissors relationships and all kinds of great stuff, and was disappointed to find that the final book is a tome, and deals a lot with C++ programming (which is not my thing), as well as AAA title management problems. Everything in the cut down pamphlet was great, though. – Kzqai Jan 10 '13 at 23:48
6

No mentions of the foundational maths of computer programming? Graph theory, number theory, set theory, and concrete mathematics, usually all lumped together into painful and poorly-taught class called "discrete mathematics" at university.

"Stupid bit tricks" save every kind of program time (and they're also usually equivalent to some string tricks and set tricks), graph types and traversals are used all over the place (even if you're just picking STL containers), and algorithmic complexity is key to optimization as languages get to higher levels.

4

It depends on what you're doing.

All game programmers should know at least high school algebra. That means:

  • A good sense of numbers
  • Comfort with basic math (add, sub, mult, divide)
  • Trigonometry (sin and cos)
  • Vectors, angle between vectors, dot product, cross product

Your graphics programmers must know:

  • All the above, and
  • Matrix algebra (for transformation matrices)
  • Polygon intersection methods / ray-polygon (see a book like Real-time collision detection

Your physics programmers must know:

  • All of the above and
  • Differential equations
  • Numerical methods
bobobobo
  • 17,074
  • 10
  • 63
  • 96
4

Understand the dot product: If two vectors have about same direction, (theta < 90 deg), then the dot product is positive, or else, negative. It can be used to test whenever the player is in sight (assuming FOV is 90 deg).

And generalize your 2D game to higher dimensions. (use vector calculations)

If you can implement a 3D engine by yourself, you are good to go.

Ming-Tang
  • 1,040
  • 1
  • 12
  • 20
3

Besides sines and cosines (which 50-75% of programmers I've met didn't know how to use), learn the magical arc-tan function and how it can be used to get the angle of any vector.

zaratustra
  • 1,506
  • 1
  • 8
  • 12