Restrict docs in list view based on child table value

I have a doc named “Loan File” which is the parent and another “Loan File Lender” which is the child table.

So each Loan File can have multiple Lenders.

Have created a login for a lender (say Lender 1), using user permissions, he can access only Lender1 for docType “Lender”

Since this lender is a link fields in child table “Loan File Lender”, he is not able to open “Loan File” where any other lender is added which is correct. But he is able to view the Loan File in list view.

Is there a way to restrict the list view as well? based on the values in the child table