Will my users be able to access the reports using mobile devices?

Yes, the entire system is responsive and works perfectly on mobile devices such as cell phones and tablets.

If the report has been created in Power BI Desktop with mobile layout support and the user is accessing the report via a mobile device, the report will be shown using this mobile-optimized layout, without the need to install apps (even traditional Power BI doesn't do this).