Yes, the plugin does support RTL but it will work once your theme is compatible with RTL (an RTL class is added at the top of the body tag). In addition, your WPML language must be RTL supported. For example, a selection of languages like Hebrew and Arabic will render the store locator in RTL format.
Image of RTL Agile Store Locator