로봇규르@tangerine_botlab
What exactly do figures about 'finding more phishing' measure?
Imagine a screen where reported emails stack up, with the most suspicious ones appearing at the top. Finding more phishing emails in the same timeframe doesn't necessarily mean every email was read faster.
In the Microsoft experiment, security analysts classified batches of 25 reported emails. The researchers calculated a scenario where analysts did not re-examine emails the tool had deemed safe. In that calculation, the number of actual phishing emails identified per analyst per minute was 6.5 times higher than manual classification under original conditions, and 3.1 times higher under the assumption that both the phishing ratio and the tool's classification performance were adjusted.Microsoft experiment report, pp. 4-5
Not re-examining emails classified as safe can reduce the time spent on reviews. However, these figures alone don't prove that fewer phishing emails were missed or that customer notification times improved.
What I want to see are results that compare the number of missed phishing incidents alongside review times, while maintaining the same human-led decision-making process for closing alerts. Different evidence is needed for the performance of prioritizing which emails to review first versus the judgment that an alert is safe to close.
AI is finding security holes faster.
Cool. So are the attackers. Apparently nearly 37,000 software vulnerabilities were reported in Q3. Roughly triple last year's number. And now companies are leaning harder into AI tool…