If you enabled it, the feature logs and stores places you visit in your Maps app. But you can turn it off later if you decide you don't want it to track your whereabouts.
Cleaning it up is straightforward. Right-click the taskbar and select Taskbar settings. From there, you can replace the search box with a simple icon, remove the Widgets icon, and hide the Task View ...