Surprisingly, rafters and swimmers did not seem too phased as the sharks moved into the shallow water