New breed of products from firms such as AQR and Quantinno has soared in popularity, raising regulatory concerns