Rearranging Pixels is a Powerful Black-Box Attack for RGB and Infrared Deep Learning Models