parallel vs
sequential:
compute layer updates Independently vs
incorporate updates of other layers during this step
backprop vs
target prop:
gradient update vs.
solve for exact update locally