Also, assume that a target that is not taken should be removed from the Btb. (The read that checked isn't possible with BRAM timing unless we latched and had an extra port, but removing the check actually improved performance a bit in CoreMark, and the pipeline should actually only be reporting a non-taken branch if we did something wrong.)