Check xfail Test Status with Plugin

[eleanorjboyd]

Hi! I found this thread because I was trying to correctly store the status xfail tests. Below is the code I am running, the plugin I wrote to connect to the given hook, and the output from the plugin. Im confused because the outcome of this xfail tests is "passed" during "setup" and "teardown" but then is listed as "skipped" during "call". Why does the xfail tests list as "skipped" during "call"? With all other tests I have written, the "call" phase has been accurate in collecting pass/fails etc but I wasn't sure about xfail. What does the skip mean and is it always going to say skip for xfail tests during this phase? Thanks and I appreciate any help!

@pytest.mark.xfail
def test_example():
    assert 1 == 2, "This test is expected to fail because 1 is not equal to 2"

@pytest.hookimpl(tryfirst=True, hookwrapper=True)
def pytest_runtest_makereport(item):
    outcome = yield
    report = outcome.get_result()
    print("pytest_report_teststatus")
    print("when", report.when)
    print("outcome", report.outcome)
    print("xfail", hasattr(report, "wasxfail"))

test_xfail.py 
pytest_report_teststatus
when setup
outcome passed
xfail False
pytest_report_teststatus
when call
outcome skipped
xfail True
xpytest_report_teststatus
when teardown
outcome passed
xfail False

originally commented on this related thread but it seems inactive: #10255
This question is related to a bug fix on the VS Code python extension, related issue: microsoft/vscode-python#4963