Jon
57770fd99d
🎯 Major Features: - Hybrid LLM configuration: Claude 3.7 Sonnet (primary) + GPT-4.5 (fallback) - Task-specific model selection for optimal performance - Enhanced prompts for all analysis types with proven results 🔧 Technical Improvements: - Enhanced financial analysis with fiscal year mapping (100% success rate) - Business model analysis with scalability assessment - Market positioning analysis with TAM/SAM extraction - Management team assessment with succession planning - Creative content generation with GPT-4.5 📊 Performance & Cost Optimization: - Claude 3.7 Sonnet: /5 per 1M tokens (82.2% MATH score) - GPT-4.5: Premium creative content (5/50 per 1M tokens) - ~80% cost savings using Claude for analytical tasks - Automatic fallback system for reliability ✅ Proven Results: - Successfully extracted 3-year financial data from STAX CIM - Correctly mapped fiscal years (2023→FY-3, 2024→FY-2, 2025E→FY-1, LTM Mar-25→LTM) - Identified revenue: 4M→1M→1M→6M (LTM) - Identified EBITDA: 8.9M→3.9M→1M→7.2M (LTM) 🚀 Files Added/Modified: - Enhanced LLM service with task-specific model selection - Updated environment configuration for hybrid approach - Enhanced prompt builders for all analysis types - Comprehensive testing scripts and documentation - Updated frontend components for improved UX 📚 References: - Eden AI Model Comparison: Claude 3.7 Sonnet vs GPT-4.5 - Artificial Analysis Benchmarks for performance metrics - Cost optimization based on model strengths and pricing
84 lines
2.4 KiB
JavaScript
84 lines
2.4 KiB
JavaScript
// Basic test for agentic RAG processor without database
|
|
const { agenticRAGProcessor } = require('./dist/services/agenticRAGProcessor');
|
|
const { v4: uuidv4 } = require('uuid');
|
|
|
|
async function testAgenticRAGBasic() {
|
|
console.log('Testing Agentic RAG Processor (Basic)...');
|
|
|
|
try {
|
|
const testDocument = `
|
|
CONFIDENTIAL INVESTMENT MEMORANDUM
|
|
|
|
Test Company, Inc.
|
|
|
|
Executive Summary
|
|
Test Company is a leading technology company with strong financial performance and market position.
|
|
|
|
Financial Performance
|
|
- Revenue: $100M (2023)
|
|
- EBITDA: $20M (2023)
|
|
- Growth Rate: 15% annually
|
|
|
|
Market Position
|
|
- Market Size: $10B
|
|
- Market Share: 5%
|
|
- Competitive Advantages: Technology, Brand, Scale
|
|
|
|
Management Team
|
|
- CEO: John Smith (10+ years experience)
|
|
- CFO: Jane Doe (15+ years experience)
|
|
|
|
Investment Opportunity
|
|
- Strong growth potential
|
|
- Market leadership position
|
|
- Technology advantage
|
|
- Experienced management team
|
|
|
|
Risks and Considerations
|
|
- Market competition
|
|
- Regulatory changes
|
|
- Technology disruption
|
|
`;
|
|
|
|
console.log('Starting agentic RAG processing...');
|
|
|
|
const result = await agenticRAGProcessor.processDocument(
|
|
testDocument,
|
|
uuidv4(), // Use proper UUID for document ID
|
|
uuidv4() // Use proper UUID for user ID
|
|
);
|
|
|
|
console.log('\n=== Agentic RAG Processing Result ===');
|
|
console.log('Success:', result.success);
|
|
console.log('Processing Time:', result.processingTime, 'ms');
|
|
console.log('API Calls:', result.apiCalls);
|
|
console.log('Total Cost:', result.totalCost);
|
|
console.log('Session ID:', result.sessionId);
|
|
console.log('Quality Metrics Count:', result.qualityMetrics.length);
|
|
|
|
if (result.error) {
|
|
console.log('Error:', result.error);
|
|
} else {
|
|
console.log('\n=== Summary ===');
|
|
console.log(result.summary);
|
|
|
|
console.log('\n=== Quality Metrics ===');
|
|
result.qualityMetrics.forEach((metric, index) => {
|
|
console.log(`${index + 1}. ${metric.metricType}: ${metric.metricValue}`);
|
|
});
|
|
}
|
|
|
|
} catch (error) {
|
|
console.error('Test failed:', error.message);
|
|
console.error('Stack trace:', error.stack);
|
|
}
|
|
}
|
|
|
|
// Run the test
|
|
testAgenticRAGBasic().then(() => {
|
|
console.log('\nTest completed.');
|
|
process.exit(0);
|
|
}).catch((error) => {
|
|
console.error('Test failed:', error);
|
|
process.exit(1);
|
|
});
|