Although we can not say for sure, astronomy probably came first. This is because even the earliest humans saw the stars and Moon and recorded their observations in art. Physics requires an understanding of mathematics, and this came much later in humans history.