From the course: Enhancing Your Productivity as a Data Scientist with Generative AI
Join today to access over 24,600 courses taught by industry experts.
Use case 9: Text preprocessing copilot
From the course: Enhancing Your Productivity as a Data Scientist with Generative AI
Use case 9: Text preprocessing copilot
- [Instructor] Remember how we excluded the text cleaning function previously and what we got from our data cleaning copilot? Well, as it turns out, when it comes to cleaning text data, we can just leverage the power of the LLM directly instead of just having it to write the code for us. And in fact, there are two main types of text processing and generative AI. Now, before we dive into the first one, make sure you're on the branch 0304B. Again, if you want, you can switch the branches directly from within code spaces. And I'm here on the 0304E branch because I'm showing you the final results. So if you want to follow along, use the beep branch. If you just want to see the final outputs switch to the branch on which I'm working on right here. So first of all, let's again load our data using the SQL script, nothing new here. And then we also pasted the data cleaning script from the previous exercise in here, so we get this little clean data frame out of this process. Now let's jump…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.