Create a view-only account for the user-protected key.
You can record the user’s public address to associate the wallet with the user.Create View Only Account
Example
The Bitski Chrome extension show examples of ledger integrations.
Allow users to use their hardware devices