I see here https://jakarta.ee/compatibility/ the list with all compatible application servers for each JEE version. The question is, are they the minimum compatible versions or do I have to use the exact same version as written in there?
For example, one of written compatible application servers for Jakarta EE 8 is Wildfly 18.0.0. Would it still be compatible with the latest Wildfly (25.0.1) as of today?
They are minimum compatible versions, but there are also maximum compatible versions existing for older specs, and that isn't told by the page explicitly. For example Wildfly 23+ (current known versions) are Jakarta EE 9 compatible. Wildfly 18 and above but below 23 are Jakarta EE 8/Java EE 8 compatible.
See source about Jakarta EE 9:
Since Jakarta EE 9 changed namespaces from Java EE 8/Jakarta EE 8, it is not possible to be compatible with both even in theory.