The Los Angeles-based venture firm, celebrated for its focus on underrepresentation, lost two anchor funders to its $36 million fund. One local member of the national team is being let go.