Yes, they do. In the Max PF column in your standings, you'll see the amount of potential points your team could have:

To find this information on the mobile app, head to the LEAGUE tab > click the green DETAILS button next to the STANDINGS text:

This always includes any taxi players who are on your team, whether they are active or not.

They count toward your Max PF because the team owner could have activated them for that week.

There isn't an option to change this setting as it's a Sleeper default. It's a way to help prevent tanking in some leagues that take point totals into consideration each year.