I felt like even Kong was more part of Peter's social circle than Judge was to Miles'. :P
Judge was so neglected that I feel like killing him off wouldn't really leave any type of impact. It's another thing on my wishlist for the next writer to address, fleshing Judge out more and actually include him more.