Project Setup

Directory Structure

Create the following directory structure for your Claude Automator project:

claude-automator/
├── src/main/java/com/claude/automator/
│   ├── states/
│   ├── transitions/
│   ├── automation/
│   ├── config/
│   └── ClaudeAutomatorApplication.java
├── src/main/resources/
│   ├── application.yml
│   └── images/
│       ├── working/
│       │   ├── claude-icon-1.png
│       │   ├── claude-icon-2.png
│       │   ├── claude-icon-3.png
│       │   └── claude-icon-4.png
│       └── prompt/
│           ├── claude-prompt-1.png
│           ├── claude-prompt-2.png
│           └── claude-prompt-3.png
├── build.gradle
└── settings.gradle

Gradle Configuration

build.gradle

plugins {
    id 'org.springframework.boot' version '3.2.0'
    id 'io.spring.dependency-management' version '1.1.4'
    id 'java'
}

group = 'com.claude'
version = '1.0.0'
sourceCompatibility = '21'

configurations {
    compileOnly {
        extendsFrom annotationProcessor
    }
}

repositories {
    mavenCentral()
}

dependencies {
    // Brobot 1.1.0+ includes Spring Boot, Lombok, SLF4J, and SikuliX as transitive dependencies
    implementation 'io.github.jspinak:brobot:1.1.0'
    
    // Additional dependencies for this project
    implementation 'com.fasterxml.jackson.core:jackson-databind:2.15.2'
    
    // Lombok annotation processor still needed for compilation
    annotationProcessor 'org.projectlombok:lombok:1.18.32'
    
    // Testing
    testImplementation 'org.springframework.boot:spring-boot-starter-test'
}

test {
    useJUnitPlatform()
}

// Copy images to build directory
task copyImages(type: Copy) {
    from 'images'
    into "$buildDir/resources/main/images"
}

processResources.dependsOn copyImages

settings.gradle (for Local Development)

rootProject.name = 'claude-automator'

// Use local Brobot library for development
includeBuild('../brobot') {
    dependencySubstitution {
        substitute module('io.github.jspinak:brobot') using project(':library')
    }
}

Local Development

The includeBuild configuration allows you to use your local Brobot library instead of the Maven Central version. This is perfect for:

• Testing new Brobot features
• Contributing to Brobot development
• Debugging library issues

Application Properties

Create src/main/resources/application.yml:

# Spring Boot Configuration
spring:
  application:
    name: claude-automator

# Logging Configuration
logging:
  level:
    com.claude.automator: DEBUG
    io.github.jspinak.brobot: INFO

# Brobot Configuration (v1.1.0+)
brobot:
  core:
    image-path: images       # Base path for images
    mock: false
  startup:
    # New auto-verification system (v1.1.0+)
    auto-verify: true
    verify-states: "Working,Prompt"  # States to verify
    clear-states-before-verify: true
    ui-stabilization-delay: 2.0
    throw-on-failure: false
    run-diagnostics-on-failure: true
  sikuli:
    highlight: true

Automatic Startup Verification

Brobot 1.1.0+ includes automatic startup verification that:

• Discovers required images from your states
• Verifies images exist before running
• Checks that expected states are visible on screen
• No custom startup code needed!

Zero-Code Startup

Unlike earlier versions, Brobot 1.1.0+ handles all startup verification through configuration. No need to write custom ImageVerifier or ActiveStateVerifier classes!

Image Preparation

Place your screenshots in the appropriate folders:

1. Working State Images (images/working/):

   • Multiple variations of Claude's response icon
   • Name them: claude-icon-1.png, claude-icon-2.png, claude-icon-3.png, claude-icon-4.png

2. Prompt State Images (images/prompt/):

   • Multiple variations of Claude's prompt interface
   • Name them: claude-prompt-1.png, claude-prompt-2.png, claude-prompt-3.png

Image Guidelines

• Remove .png extensions when referencing images in code
• Crop images to show only the relevant UI element
• Include multiple variations if the element changes appearance
• Images are automatically discovered from your state definitions

Main Application Class

Create src/main/java/com/claude/automator/ClaudeAutomatorApplication.java:

package com.claude.automator;

import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.context.annotation.ComponentScan;

@SpringBootApplication
@ComponentScan(basePackages = {
    "com.claude.automator",
    "io.github.jspinak.brobot"  // Include Brobot components
})
public class ClaudeAutomatorApplication {
    public static void main(String[] args) {
        SpringApplication.run(ClaudeAutomatorApplication.class, args);
    }
}

Next Steps

With the project structure in place, we'll start implementing the states using modern Brobot patterns.