Logistically speaking we're getting very close to the enwiki launch, and it seems redesigning along these lines is probably not feasible before then. My suggestion would be to simply disable the Dismiss feature in its current state, perhaps also ask our users on enwiki about how they'd like this behavior to work, and then make a call in the weeks following launch. That way we're adding to the product at our leisure, rather than trying to rewire a feature already in front of tons of users. 

Thanks a lot for keeping up with all the feedback on this list Fabrice, and for soliciting more.