Failed test cases not causing CI jobs to fail

[marosset]

A test failure was observed that should have caused the CI jobs to fail but didn't

https://github.com/hyperlight-dev/hyperlight/actions/runs/12827492104/job/35770312541?pr=135#step:12:412

Capturing the relevant test output here in case the github actions logs get deleted

I looked briefly and didn't see anything obviously wrong with the just targets so this might require a deeper look

cargo test  --profile=dev  --lib
   Compiling hyperlight-common v0.1.0 (D:\a\_work\hyperlight\hyperlight\src\hyperlight_common)
   Compiling hyperlight-testing v0.0.0 (D:\a\_work\hyperlight\hyperlight\src\hyperlight_testing)
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 1.75s
     Running unittests src\lib.rs (target\debug\deps\hyperlight_common-c286475b9fdc32cb.exe)

running 1 test
test flatbuffer_wrappers::function_call::tests::read_from_flatbuffer ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src\lib.rs (target\debug\deps\hyperlight_host-952c13f888be941c.exe)

running 78 tests
test func::call_ctx::tests::singleusesandbox_multi_call ... ok
test func::call_ctx::tests::ensure_multiusesandbox_multi_calls_dont_reset_state ... ok
test func::call_ctx::tests::ensure_multiusesandbox_single_calls_do_reset_state ... ok
test func::call_ctx::tests::singleusesandbox_single_call ... ok
test func::guest_dispatch::tests::test_call_guest_function_by_name_hv ... ok
test func::call_ctx::tests::test_multi_call_multi_thread ... ok
test func::guest_dispatch::tests::test_execute_in_host ... ok
test hypervisor::hyperv_windows::tests::test_init ... ok
test hypervisor::hypervisor_handler::tests::create_1000_sandboxes ... ignored
test func::guest_dispatch::tests::test_terminate_vcpu_spinning_cpu ... ok
test hypervisor::hypervisor_handler::tests::create_10_sandboxes ... ok
test hypervisor::hypervisor_handler::tests::hello_world ... ok
test func::guest_dispatch::tests::test_terminate_vcpu_and_then_call_guest_function_on_the_same_host_thread ... ok
test hypervisor::metrics::tests::test_enum_has_variant_for_all_metrics ... ok
test hypervisor::metrics::tests::test_gather_metrics ... ignored
test hypervisor::metrics::tests::test_metric_definitions ... ok
test hypervisor::metrics::tests::test_metrics ... ignored
test func::guest_dispatch::tests::test_terminate_vcpu_calling_host_spinning_cpu ... ok
test hypervisor::hypervisor_handler::tests::terminate_execution_of_an_already_finished_function_then_call_another_function ... ok
test hypervisor::surrogate_process_manager::tests::windows_guard_page ... ok
test mem::layout::tests::test_get_memory_size ... ok
test mem::layout::tests::test_round_up ... ok
test mem::mgr::tests::get_host_error_none ... ok
test mem::mgr::tests::load_guest_binary_common ... ok
test mem::mgr::tests::round_trip_host_error ... ok
test mem::pe::pe_info::tests::load_pe_info ... ok
test mem::ptr::tests::ptr_basic_ops ... ok
test mem::ptr::tests::ptr_fail ... ok
test mem::ptr_addr_space::tests::guest_addr_space_base ... ok
test mem::ptr_offset::tests::add_numeric_types ... ok
test mem::ptr_offset::tests::i64_roundtrip ... ok
test mem::ptr_offset::tests::round_up_to ... ok
test mem::ptr_offset::tests::usize_roundtrip ... ok
test mem::shared_mem::tests::alloc_fail ... ok
test mem::shared_mem::tests::clone ... ok
test mem::shared_mem::tests::copy_all_to_vec ... ok
test mem::shared_mem::tests::copy_into_from ... ok
test mem::shared_mem::tests::fill ... ok
test hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function ... FAILED
test mem::shared_mem_snapshot::tests::restore_replace ... ok
test sandbox::config::tests::min_sizes ... ok
test sandbox::config::tests::overrides ... ok
test sandbox::config::tests::proptests::error_buffer_size ... ok
test sandbox::config::tests::proptests::guest_panic_context_buffer_size ... ok
test sandbox::config::tests::proptests::heap_size_override ... ok
test sandbox::config::tests::proptests::host_exception_size ... ok
test sandbox::config::tests::proptests::host_function_definition_size ... ok
test sandbox::config::tests::proptests::input_data_size ... ok
test sandbox::config::tests::proptests::max_execution_time ... ok
test mem::shared_mem::tests::read_write_i32 ... ok
test sandbox::config::tests::proptests::max_initialization_time ... ok
test sandbox::config::tests::proptests::max_wait_for_cancellation ... ok
test sandbox::config::tests::proptests::output_data_size ... ok
test sandbox::config::tests::proptests::stack_size_override ... ok
test sandbox::initialized_multi_use::tests::evolve_devolve_handles_state_correctly ... ok
test sandbox::metrics::tests::test_enum_has_variant_for_all_metrics ... ok
test sandbox::metrics::tests::test_gather_metrics ... ignored
test sandbox::metrics::tests::test_metric_definitions ... ok
test sandbox::metrics::tests::test_metrics ... ignored
test sandbox::outb::tests::test_log_outb_log ... ignored
test sandbox::outb::tests::test_trace_outb_log ... ignored
test sandbox::tests::check_create_and_use_sandbox_on_different_threads ... ok
test sandbox::uninitialized::tests::check_create_and_use_sandbox_on_different_threads ... ok
test sandbox::uninitialized::tests::test_host_functions ... ok
test sandbox::uninitialized::tests::test_host_print ... ok
test sandbox::uninitialized::tests::test_in_process ... ok
test sandbox::uninitialized::tests::test_invalid_path ... ok
test sandbox::initialized_multi_use::tests::test_with_small_stack_and_heap ... ok
test sandbox::uninitialized::tests::test_load_guest_binary_manual ... ok
test sandbox::uninitialized::tests::test_log_trace ... ignored
test sandbox::uninitialized::tests::test_new_sandbox ... ok
test sandbox::uninitialized::tests::test_trace_trace ... ignored
test sandbox::uninitialized_evolve::tests::test_evolve ... ok
test sandbox::uninitialized_evolve::tests::test_evolve_in_proc ... ok
test sandbox_state::transition::tests::test_evolve_devolve ... ok
test hypervisor::surrogate_process_manager::tests::test_surrogate_process_manager ... ok
test sandbox::uninitialized::tests::test_load_guest_binary_load_lib ... ok
test mem::loaded_lib::tests::test_universal ... ok

failures:

---- hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function stdout ----
thread 'hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function' panicked at src\hyperlight_host\src\hypervisor\hypervisor_handler.rs:947:39:
called `Result::unwrap()` on an `Err` value: HypervisorHandlerMessageReceiveTimedout
stack backtrace:
   0: std::panicking::begin_panic_handler
             at /rustc/eeb90cda1969[383](https://github.com/hyperlight-dev/hyperlight/actions/runs/12827492104/job/35770312541?pr=135#step:12:384)f56a2637cbd3037bdf598841c/library\std\src\panicking.rs:665
   1: core::panicking::panic_fmt
             at /rustc/eeb90cda1969383f56a2637cbd3037bdf598841c/library\core\src\panicking.rs:74
   2: core::result::unwrap_failed
             at /rustc/eeb90cda1969383f56a2637cbd3037bdf598841c/library\core\src\result.rs:1679
   3: enum2$<core::result::Result<hyperlight_host::sandbox::initialized_multi_use::MultiUseSandbox,enum2$<hyperlight_host::error::HyperlightError> > >::unwrap
             at /rustc/eeb90cda1969383f56a2637cbd3037bdf598841c\library\core\src\result.rs:1102
   4: hyperlight_host::hypervisor::hypervisor_handler::tests::create_multi_use_sandbox
             at .\src\hypervisor\hypervisor_handler.rs:947
   5: hyperlight_host::hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function
             at .\src\hypervisor\hypervisor_handler.rs:1003
   6: hyperlight_host::hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function::closure$0
             at .\src\hypervisor\hypervisor_handler.rs:1002
   7: core::ops::function::FnOnce::call_once<hyperlight_host::hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function::closure_env$0,tuple$<> >
             at /rustc/eeb90cda1969383f56a2637cbd3037bdf598841c\library\core\src\ops\function.rs:250
   8: core::ops::function::FnOnce::call_once
             at /rustc/eeb90cda1969383f56a2637cbd3037bdf598841c/library\core\src\ops\function.rs:250
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.


failures:
    hypervisor::hypervisor_handler::tests::terminate_execution_then_call_another_function

test result: FAILED. 68 passed; 1 failed; 9 ignored; 0 measured; 0 filtered out; finished in 13.39s

error: test failed, to rerun pass `-p hyperlight-host --lib`
error: Recipe `test-rust` failed on line 81 with exit code 1
# integration tests
# run execute_on_heap test with feature "executable_heap" on and off
$env:GUEST="rust"; cargo test --profile=dev --test integration_test execute_on_heap --features executable_heap -- --ignored
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.29s
     Running tests\integration_test.rs (target\debug\deps\integration_test-86ca243cbdea4215.exe)