I have the following scribble document that uses a bibliography:
#lang scribble/base
@(require scriblib/autobib)
@(define-cite cite citet gen-bib)
This is a citation@cite[the-citation].
@(define the-citation
(make-bib #:title "Hello"
#:author "World"
#:date "1337"))
@gen-bib[]
The document's result looks something like this:
The bibliography section is title 'BIBLIOGRAPHY', but I would actually like it to be titled 'REFERENCES', is this possible with scribble, or do I have to drop into latex hacking?

Yes, it is possible with Scribble (or rather,
scriblib/autobib).The
gen-bibfunction you used (defined withdefine-cite), has an option#:sec-title, that you can use to set the title for your bibliography. If you change that line to:The you will get the same document, except for a 'REFERENCES' section rather than a 'BIBLIOGRAPHY' one.
The code will look like: