Best advice I can give with the little information is go speak to someone at CAB to find out where your rights are regarding your daughter.
As to the other part, wanting to get back with your ex and her mother causing a rift between you, also speak with the CAB, as they may be able to get you some support or an advocate, depending on your age, your ex's age, living situations etc.
Good luck x