No, the Prometheus chart is very bare bones. You probably want to use the kube-prometheus-stack chart.
This will give you the full Prometheus operator, which includes the blackbox exporter and the Probe CRD, which makes it much easier to define blackbox targets.