How can we have two search bar on one page using Finsweet CMS Filter?

Oohh I get what you are after, you want to filter the filter options, not the actual list.

This is not possible with CMS Filter natively, you might want to look at this post Filter CMS Form Select Options to see if the custom functionality can be adjusted to your use case.