I know that there is a 20 mA/pin source limit on the '64, but is there
a per port or per chip limit on current sourced?

In short, can I directly run two 7 segment displays (one per port, ~10 mA
per segment) continuously without a problem?