Twenty-three people were rescued by helicopter after an ice shelf broke away in Georgian Bay, with some fearing the worst and calling loved ones.