The problem with “only” is that we tend to put the word too early in the sentence. I’ve mentioned this several times, most recently two posts ago. (Search for “only” in the search box in the upper right corner for more.)
The rule in English is to put adjectives directly in front of the word they modify, and usually we don’t have trouble with this, except in the case of “only” and a few other equivalent adjectives. Here’s an example:
Hurricane Helene is taking a stab at Category 3 strength in the remote Eastern Atlantic, where at least its prowess is harmless.
https://www.wunderground.com/cat6/Week-Landfall-Threats-Florence-Mangkhut-Olivia-Isaac-and-More
I don’t think the writer intends to modify “prowess.” I think the intent is to modify “harmless.”
Hurricane Helene is taking a stab at Category 3 strength in the remote Eastern Atlantic, where its prowess is at least harmless.
The writer could even make “at least” into an aside by using commas:
Hurricane Helene is taking a stab at Category 3 strength in the remote Eastern Atlantic, where, at least, its prowess is harmless.