Can I prospect/fossick/detect on beaches labelled as restricted crown land in geovic?

[campgas]

Cross-referencing different websites and forums, I find myself stuck. I do understand that I cannot go to (1. unavailable crown land; 2. s7 exempted areas). However, the 'restricted crown land' layer in geovic is the thing that confuses me. I realised that many beaches in Victoria are labelled as restricted crown land. Does that mean I can only go to the few beaches that don't fall into the 3 categories stated above? Or are there some exceptions to some beaches labelled as restricted crown land? Do I need to contact the local council when I want to conduct the activities stated on those 'restricted' beaches? Thanks Prior!