Fast and Expressive Sketch Structured Transform for Efficient Inference