Trying to do this by hand is kind of error prone, but it’s something. The actual positions of the cameras could probably be calculated, but many of them are mobile throughout the game. For NFL games, they’ve already started doing on the fly 3D generation, but that’s more of a gimmick.