# I'm getting constant TLS handshake errors from an unknown source

**URL:** <https://discuss.prometheus.io/t/im-getting-constant-tls-handshake-errors-from-an-unknown-source/3250>\
**Category:** Prometheus server\
**Created:** [January 14, 2025, 3:18am UTC](https://discuss.prometheus.io/t/im-getting-constant-tls-handshake-errors-from-an-unknown-source/3250 "2025-01-14T03:18:35Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![tunztunztunz](https://dub1.discourse-cdn.com/flex017/user_avatar/discuss.prometheus.io/tunztunztunz/32/1102_2.png) [@tunztunztunz](https://discuss.prometheus.io/u/tunztunztunz)\
**Post date:** [January 14, 2025, 3:18am UTC](https://discuss.prometheus.io/t/im-getting-constant-tls-handshake-errors-from-an-unknown-source/3250/1 "2025-01-14T03:18:35Z")

</div>

I have a weird issue with Prometheus using the [community helm chart](https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus).

I’m deploying it fine, it runs, I can scrape metrics endpoints for some other services over HTTPS, have gotten services working with HTTPS/TLS, however I keep getting my logs spammed with a `TLS handshake` error every 5ish seconds after Prometheus boots up. Each request also appears to be from a different IP address. Some examples of the error are:

```auto
time=2025-01-14T02:57:05.864Z level=ERROR source=server.go:3487 msg="http: TLS handshake error from 127.0.0.1:54256: client sent an HTTP request to an HTTPS server" component=web
time=2025-01-14T02:57:10.868Z level=ERROR source=server.go:3487 msg="http: TLS handshake error from 127.0.0.1:60034: client sent an HTTP request to an HTTPS server" component=web
time=2025-01-14T02:57:15.865Z level=ERROR source=server.go:3487 msg="http: TLS handshake error from 127.0.0.1:60038: client sent an HTTP request to an HTTPS server" component=web
time=2025-01-14T02:57:20.865Z level=ERROR source=server.go:3487 msg="http: TLS handshake error from 127.0.0.1:35652: client sent an HTTP request to an HTTPS server" component=web
time=2025-01-14T03:06:05.876Z level=ERROR source=server.go:3487 msg="http: TLS handshake error from 127.0.0.1:54826: EOF" component=web

```

Something is apparently making non-stop HTTP requests to my prometheus server, but I can’t figure out what. I’ve tried narrowing down the culprits by:

- Removing all health probes.
- Removing all scraping targets.
- Removed Prometheus as a data source in Grafana.

I’m not sure what else could be making this request at this point. I thought it was for sure the probes, but I’ve set them to `null` within the templates and I’m still getting the errors. I’m at the end of my rope! Any ideas?

---

<div class="post-metadata">

**Author:** ![bbigras](https://avatars.discourse-cdn.com/v4/letter/b/9d8465/32.png) [@bbigras](https://discuss.prometheus.io/u/bbigras)\
**Post date:** [February 27, 2025, 9:06pm UTC](https://discuss.prometheus.io/t/im-getting-constant-tls-handshake-errors-from-an-unknown-source/3250/2 "2025-02-27T21:06:12Z")

</div>

Did you try with an older version of the chart?

I think I have this problem with 69.5.2 but not with 68.5.0.

---

<div class="post-metadata">

**Author:** ![tunztunztunz](https://dub1.discourse-cdn.com/flex017/user_avatar/discuss.prometheus.io/tunztunztunz/32/1102_2.png) [@tunztunztunz](https://discuss.prometheus.io/u/tunztunztunz)\
**Post date:** [March 12, 2025, 12:44am UTC](https://discuss.prometheus.io/t/im-getting-constant-tls-handshake-errors-from-an-unknown-source/3250/3 "2025-03-12T00:44:12Z")

</div>

I did not try downgrade because I forgot I made this post and didn’t see your reply. I think it was ultimately the probes that caused this error. The workaround I ended up going with was changing the probe type to `EXEC` and writing a custom `readinessProbeCommand` that basically returns healthy if `https://localhost:9090/-/healthy` has any response at all.

I would hardly call it a solution, but it at least works, I guess.
