Dùng ChatGPT phân loại ảnh tự động, tự động hóa task trên máy của bạn nhờ Apple Intelligence

Key Concepts

Apple Intelligence, Shortcuts app (macOS), Automation, On-device AI, Private Cloud Compute, Chat GPT integration, File categorization, Text-to-script conversion, Workflow automation, Use Model action.

File Categorization with AI

The video demonstrates how to leverage Apple Intelligence through the Shortcuts app on macOS to automate tasks, specifically file categorization. The presenter uses a shortcut to automatically sort images into different folders based on their content (human, device, landscape, car).

Process:

1. Folder Setup: A folder named "test" contains unsorted images, along with subfolders named after the categories (human, device, landscape, car).
2. Shortcut Execution: The shortcut is run, and the user selects the "test" folder.
3. Chat GPT Integration: The shortcut uses the "Use Chat GPT" action to send the folder's contents to Chat GPT with a prompt instructing it to categorize the images into the four categories. The prompt is: "phân loại những cái hình này theo bốn thể loại khác nhau là human, device, landscape và car là xe hơi" (categorize these images into four different categories: human, device, landscape and car).
4. Data Processing: Chat GPT returns a JSON dictionary containing the filename and corresponding category for each image.
5. File Movement: The shortcut iterates through the JSON data and moves each image to the appropriate subfolder based on the category assigned by Chat GPT.
6. Completion Notification: The shortcut displays a notification indicating the number of files processed.

Example: Images containing cars are automatically moved to the "car" folder, and images with people are moved to the "human" folder.

Key Points:

• Chat GPT is used for image classification because it performs better than the on-device model in this specific task.
• The shortcut automates the process of reading file contents, sending them to Chat GPT, and moving files based on the AI's output.
• The presenter provides a link to the shortcut for users to download and customize.

Use Model Action and AI Options

The video highlights the "Use Model" action in Shortcuts, which allows users to integrate AI models into their workflows. There are three options for running AI models:

1. Private Cloud Compute: Runs Apple Intelligence models on Apple's servers. Data is processed and returned to the user, then immediately deleted from the server to ensure privacy.
2. On Device: Runs AI models directly on the user's computer. This is useful for situations where data cannot be sent to the cloud due to privacy concerns or company policies.
3. Extension (Chat GPT): Integrates with Chat GPT, allowing users to leverage its powerful language processing capabilities.

Key Points:

• Private Cloud Compute offers a balance between AI power and privacy.
• On-device models are less powerful but provide offline processing and data security.
• Chat GPT integration allows for complex tasks like text generation and analysis.

Automation and Triggering Shortcuts

The video demonstrates how to automate shortcuts using the "Automation" feature in Shortcuts. This allows shortcuts to be triggered automatically based on specific events, such as changes to a folder's contents.

Process:

1. Create Automation: An automation is created to monitor the "test" folder for changes.
2. Trigger Event: The automation is set to trigger when a file is added or modified in the "test" folder.
3. Shortcut Selection: The "Categorize Folder" shortcut is selected to run when the trigger event occurs.
4. Run Immediately vs. Confirmation: The user can choose to run the shortcut immediately or require confirmation before running.
5. Automatic Execution: When a new image is added to the "test" folder, the automation automatically runs the "Categorize Folder" shortcut, which categorizes the image and moves it to the appropriate subfolder.

Example: When new images are added to the "test" folder, the shortcut automatically categorizes them and moves them to the correct subfolders without user intervention.

Key Points:

• Automations can be triggered by various events, such as folder changes, time of day, or location.
• Users can customize the automation to run immediately or require confirmation.
• Automations allow for completely hands-free workflow automation.

Text-to-Script Conversion

The video showcases another example of using Shortcuts and Chat GPT to convert a simple text outline into a longer, more detailed script.

Process:

1. Outline Creation: A simple text outline is created in a note-taking app.
2. Text Selection: The text outline is selected.
3. Service Menu Activation: A right-click on the selected text reveals a "Service" menu option.
4. Shortcut Execution: The "Chuyển text thành kịch bản dài" (Convert text to long script) shortcut is selected from the Service menu.
5. Chat GPT Processing: The shortcut sends the text outline to Chat GPT with a prompt to expand it into a full script.
6. Clipboard Output: The generated script is copied to the clipboard.
7. Pasting: The user pastes the script into a document.

Key Points:

• The shortcut can be accessed directly from the Service menu, eliminating the need to open the Shortcuts app.
• The user can choose to use Chat GPT, the on-device model, or the Apple cloud model for text generation.
• This example demonstrates how Shortcuts can be integrated into existing workflows to automate tasks.

Conclusion

The video demonstrates the power of combining Apple Intelligence and the Shortcuts app on macOS to automate various tasks. The "Use Model" action provides access to different AI models, including on-device models, private cloud compute, and Chat GPT. The automation feature allows shortcuts to be triggered automatically based on specific events. The presenter emphasizes the ease of use and flexibility of Shortcuts, making it a valuable tool for automating workflows and improving productivity. The presenter believes that the integration of Vietnamese language support in Apple Intelligence will further enhance the capabilities of Shortcuts in the future. The presenter highlights that macOS has an advantage due to the speed of on-device models and the customizability of the Shortcuts app.