As per the title - I've found examples of how to do this using regular .NET
E.g: Web Api How to add a Header parameter for all API in Swagger
However, I can't find any examples, or documentation, showing how to accomplish the same thing when using .NET Core 2.0.
There are two type of headers in swagger/OpenApi request headers and response headers.
Request Headers
Request headers are straightforward to implement, all you need to do is decorate your controller and/or operation like this:
Response Headers
There are no declarative way of specifying response headers in Asp.Net Core or Swashbuckle, so you'll have to do this manually.
Below example will return a custom header name x-my-header.
We now need to instruct swagger to include the response header. This is done through the IOperationFilter, please see Swashbuckle documentation on how filters work. Filters can be applied globally or per operation, however you can't customize the behavior by passing parameters into its constructor, do to the way filters are declared (by type only). As a consequence you'll have to write an operation filter per API method that returns one or more response headers. Alternatively you can define an attribute to declare response headers for an operation.
This gives us the ability to declare per response code one or more headers.
Now that we have an attribute that defines our intend we can make a generic operation filter.
All we need to do now is wire-up the operation filter to swagger generation.
I hope this is enough to get you going.