In increasing complexity:
1) use the Styleattrs statement to set graph properties.
add Styleattrs datacolors=(pink green); to your graph.
The first color will go with the first encountered group value. So Female would be before Male with the PanelBY, and Pink would associate with Female.
The fun part with this finding which attribute: Datacolors, Datacontrastcolors, Datafillpatterns, Datalinepatterns or Datasymbols need to be used for which element of the graph.
2) a DATTRMAP data set, discrete attribute map, which contains specific variable names to link values to the color, contrast color, line attribute, text color or attribute. The data set would be referenced on the Proc Sgpanel (or Sgplot) statement and the plot statements, such as your Histogram would include an ATTRID= option to indicate which values of the ID variable are used with that statement
3) Create a custom style using Proc Template and make that the active ODS style for the procedure by using it with the STYLE=option of an ODS destination statement.