Maples are not the easiest subject for cuttings. The smaller ones take better than larger ones in my experience. The red cultivars are probably a little harder than regular greens to root.
The layer is a better solution probably. Try the perlite you seem to be using for the cuttings as the rooting medium for the layer next time- it has given me great results!