Is there a plugin (or way) to allow users to only edit custom fields on an assigned post?

Ideally I'd create a post, assign it to a user and that user would then have access to edit custom fields on that post only. Those custom fields would be displayed in the sidebar.

The goal is to have posts written about individuals but allow those individuals to edit their own contact info.

Any plugins or workarounds for something like this?