The very moment, he reacted in anger.
This construction is grammatically correct but less commonly used at the beginning of a sentence. It works when you want to emphasize the exact point in time when something happened. However, the more natural phrasing would typically be "At the very moment".