IPA: Don't hang onto memory longer than necessary
    
    This request and attached memory would be freed at the end of
    access-check processing, but it's a waste to keep it around.