Now that would have been a really smart move. Mangione is apparently quite smart. Since he stayed in the area (for whatever reason) it seem like he was expecting to be caught at some point. Keeping the murder weapon on him (if he did it) days after the murder would be extremely stupid.