King Chung Huang
07/25/2019, 3:02 PMtokens
right now. Can I log the tokens directly from the pipeline?
@solid
def print_tokens(context, tokens):
<http://context.log.info|context.log.info>(str(tokens))
return tokens
@pipeline
def test_tokenize():
tokens = tokenize()
print_tokens(tokens)