Before: runtime! ale_linters/cloudformation/cfn_python_lint.vim call ale#test#SetFilename('sample.template.yaml') After: call ale#linter#Reset() Execute(The cfn_python_lint handler should parse items correctly): AssertEqual \ [ \ { \ 'lnum': '96', \ 'col': '7', \ 'end_lnum': '96', \ 'end_col': '15', \ 'text': 'Property Resources/Sample/Properties/FromPort should be of type Integer', \ 'code': 'E3012', \ 'type': 'E', \ }, \ { \ 'lnum': '97', \ 'col': '7', \ 'end_lnum': '97', \ 'end_col': '15', \ 'text': 'AllowedPattern and/or AllowedValues for Parameter should be specified at Parameters/SampleIpAddress. Example for AllowedPattern "^(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\.){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])(\/([0-9]|[1-2][0-9]|3[0-2]))$"', \ 'code': 'W2509', \ 'type': 'W', \ }, \ ], \ ale_linters#cloudformation#cfn_python_lint#Handle(bufnr(''), [ \ fnamemodify(tempname(), ':h') . '/sample.template.yaml:96:7:96:15:E3012:Property Resources/Sample/Properties/FromPort should be of type Integer', \ fnamemodify(tempname(), ':h') . '/sample.template.yaml:97:7:97:15:W2509:AllowedPattern and/or AllowedValues for Parameter should be specified at Parameters/SampleIpAddress. Example for AllowedPattern "^(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\.){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])(\/([0-9]|[1-2][0-9]|3[0-2]))$"', \ ])