creating vite template & trying to get it to work

[juancastano]

No description provided.

[juancastano]

• Finally got a template that works BEN-783 #15
• creating vite template & trying to get it to work #14 👈 (View in Graphite)
• some more light prompt engineering #11 : 2 other dependent PRs (#12 , #13 )
• adding tailwind + postcss config #10
• this isn't going to do much, but adapt structure of vue template to use package.json for deps #9
• update return type of generation endpoint and start rendering in iframe #8
• custom vite config to allow for any hosts to access #7
• start calling prod API #6
• return build output #5
• tiny bit of prompt engineering #4
• run the app in the background #3
• Added template and tweaked e2b logic #2
• Code generation working. Need to figure out e2b #1
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[benchify]

🧪 Benchify Analysis of PR 14

The provided tests indicate that the REACT_APP_USER_PROMPT function has some issues with its output formatting. Specifically, the test that checks if the output starts with the expected string "Create a React application with the following requirements:" is failing. The error suggests that the actual output has an extra newline character at the beginning.

On the other hand, the test that checks if the function accepts only string inputs for the description parameter is passing, indicating that the function correctly handles string inputs.

To resolve the issue, it's recommended to review the REACT_APP_USER_PROMPT function to ensure it correctly formats its output, removing any unwanted newline characters.

[benchify]

❌ Output String Format Validation

The output string must start with 'Create a React application with the following requirements:'.

Outcome	Example Input	# Inputs	% of Total
❌	superjson.parse('{"json":[["MaFa"]]}')... view full input	400	100.0%

view all inputs
The property-based test failed because the generated string did not start with the expected prefix 'Create a React application with the following requirements:'. The input argument was "{"json":[["MaFa"]]}" and the actual output string started with a newline character, causing the assertion to fail.

Stack Trace

Error: expect(received).toStartWith(expected)

Expected to start with: "Create a React application with the following requirements:"
Received: "\nCreate a React application with the following requirements:\nMaFa"

    at toStartWith (unknown)
    at <anonymous> (/app/repo/lib/pver_5f848e4f-dedb-422b-8b7b-8caba561ef32.test.ts:44:52)
    at <anonymous> (/app/configuration/fc.setup.ts:183:11)
    at run (/app/node_modules/fast-check/lib/esm/check/property/Property.generic.js:46:33)
    at runIt (/app/node_modules/fast-check/lib/esm/check/runner/Runner.js:18:30)
    at check (/app/node_modules/fast-check/lib/esm/check/runner/Runner.js:62:11)
    at <anonymous> (/app/configuration/fc.setup.ts:197:14)
    at assertWithLogging (/app/configuration/fc.setup.ts:125:3)
    at <anonymous> (/app/repo/lib/pver_5f848e4f-dedb-422b-8b7b-8caba561ef32.test.ts:37:6)

Unit Tests

// Unit Test for "Output String Format Validation": The output string must start with 'Create a React application with the following requirements:'.
function benchify_s(s) {
    return s.replace(/[^a-zA-Z0-9]/g, 'a');
}

it('benchify_s_exec_test_failing_0', () => {
  const args = superjson.parse('{"json":[["MaFa"]]}');

  benchify_s(...args);
});

[benchify]

✅ Description Must Be a String

The function should accept only string inputs for the 'description' parameter.

Outcome	Example Input	# Inputs	% of Total
✅	superjson.parse('{"json":[["]xE"]]}')... view full input	200	100.0%

view all inputs
The test has passed, which means the REACT_APP_USER_PROMPT function successfully accepted the input string ["{\"json\":[[\"]xE\"]]"] and returned a defined result as expected. The function correctly handled the string input and returned a prompt message with the provided description. No issues were found in this test scenario.

Unit Tests

// Unit Test for "Description Must Be a String": The function should accept only string inputs for the 'description' parameter.
function benchify_description(description) {
    const result = REACT_APP_USER_PROMPT(description);
    expect(result).toBeDefined();
}

it('benchify_description_exec_test_passing_0', () => {
  const args = superjson.parse('{"json":[["]xE"]]}');

  benchify_description(...args);
});

[juancastano]

Merge activity

• May 19, 6:16 AM EDT: A user started a stack merge that includes this pull request via Graphite.
• May 19, 6:47 AM EDT: Graphite rebased this pull request as part of a merge.
• May 19, 6:49 AM EDT: @juancastano merged this pull request with Graphite.