You have to decide whether a man that is known without a doubt to be innocent is sent to jail or not. If you say send him to jail then 100 absolutely know guilty men will stay in jail. If you let the Innocent man go free then you most also let those 100 know men go free. What do you do? This is kind of a society good vs. Individual good thing. Though society is made up of individuals. I don't think offenses should matter, yet if you want the Innocent man could be imprisoned for up to life potentially put to death, the "100" are of all type; rapist, murderers, drug-slingers, and evil wall street types all serving from years to life to execution also.
Anyway just thought it was an interesting question and thought I'd see what you all thought.