If your parents had another daughter in the meantime (or if your older brother became female), “my sister” would still be a valid reference, to a completely different person.