How to create a custom step function state machine using the workflow

Yes, you can create your own workflows using Step Functions. This can be done using AWS Step Functions Workflow Studio. which is a visual editor, or using the Amazon States Language. A number of sample workflows and patterns can be found here: https://github.com/aws-samples/step-functions-workflows-collection