中国DOS联盟

Using for to analyze the content of a certain text. In case the lines separated by spaces in the text are broken and the strings after the spaces are cut off, I see some people use "tokens=*" and some use "delims=", and some people use both. What are the differences in these two usages? I personally understand that the effects should be the same. "tokens=*" means taking all fields, "delims=" means not specifying any delimiter. If there are spaces in the first line of the text to break it, using one of them can make the analyzed string not break, right? Is it that you can use either one according to personal preference, or are there some tips in the usage of these two? I hope the friends who know will tell me, thank you for replying in your busy schedule! ;)

Last edited by oilio on 2007-2-8 at 08:51 PM ]

Just try it yourself.

delims refers to the delimiter, and tokens refers to the selected string fragments after splitting.

Take the following code as an example:
FOR /F "eol=; tokens=2,3* delims=," %i in ("a,bc,def,ghij,jklmn") do @echo %i %j %k
Here, Delims is ",", so "a,bc,def,ghij,klmn") is split into 5 segments: a bc def ghij klmn.
tokens=2,3* means to take the 2nd fragment, the 3rd fragment, and all fragments after the 3rd fragment. That is:
%i=bc
%j=def
%k=ghij,klmn (here "*" means that from the 4th fragment onwards, no more splitting is done, all are assigned to %k)
So if you use "tokens=*" in your code, it means no splitting is performed, and the current line is directly assigned to the loop variable.

Last edited by lelige on 2007-3-20 at 11:42 PM ]

It can simply give you an example. For example, there is a text a.txt with the following content:
hello world
thank you very
you are very good

These three lines of content
for /f "tokens=*" %a in (a.txt) do @echo %a
hello world
thank you very
you are very good

It can indirectly delete the spaces in front of each line

for /f "delims=" %a in (a.txt) do @echo %a

hello world
thank you very
you are very good

Still the original text, heh heh. You can explore the specific parameters and applications inside by yourself

Thank you, brother upstairs. I seem to have grasped a little bit of the essence.

First, top it, and learn slowly

After seeing the 3rd floor, I gradually understood, thank you

It is suggested to ban the ID of the person upstairs and delete all their posts.

@echo off

title for命令中 "tokens=2 和 delims=," 的用法

echo.

echo 床前明月光，疑是地上霜，举头望明月，低头思故乡

echo.

echo 如果我要用for将四句诗都显示到屏幕上，不需要任何参数即能实现：

echo for /f %%i in (静夜思.txt) do echo %%i

ECHO 1-1床前明月光，1-2疑是地上霜，1-3举头望明月，1-4低头思故乡。> 静夜思.txt

ECHO 2-1床前明月光，2-2疑是地上霜，2-3举头望明月，2-4低头思故乡。>>静夜思.txt

ECHO 3-1床前明月光，3-2疑是地上霜，3-3举头望明月，3-4低头思故乡。>>静夜思.txt

for /f %%i in (静夜思.txt) do echo %%i

pause>nul

echo.

ECHO 如果我只要“床前明月光”这句话，就需要delims帮忙了：

ECHO for /f "delims=，" %%i in (静夜思.txt) do echo %%i 

for /f "delims=，" %%i in (静夜思.txt) do echo %%i 

ECHO delims=后面跟了一个逗号，表示用原文中的逗号作为分隔符（划分的方法）将古诗分成四个小节。默认情况下，delims只显示分隔符前的第一小节，分隔符通常被忽略掉。

pause>nul

echo.

ECHO 显示其他小节的诗句要用到列提取命令“tokens”。

ECHO for /f "tokens=2 delims=，" %%i in (静夜思.txt) do echo %%i 

for /f "tokens=2 delims=，" %%i in (静夜思.txt) do echo %%i

ECHO tokens=2 表示对象（在这里是每行）的第2个字符集

pause>nul

Originally posted by Climbing at 2007-2-9 21:39:
Just try it yourself.

Helping others improve themselves is beneficial to both others and oneself

@echo off

title Usage of "tokens=2 and delims=," in the for command

echo.

echo Before the bed the bright moon shines, I think frost on the ground it is. Raising my head, I watch the bright moon, lowering my head, I think of home.

echo.

echo If I want to display all four lines of the poem on the screen using for without any parameters, it can be achieved:

echo for /f %%i in (JingYeSi.txt) do echo %%i

ECHO 1-1 Before the bed the bright moon shines, 1-2 I think frost on the ground it is, 1-3 Raising my head, I watch the bright moon, 1-4 Lowering my head, I think of home.> JingYeSi.txt

ECHO 2-1 Before the bed the bright moon shines, 2-2 I think frost on the ground it is, 2-3 Raising my head, I watch the bright moon, 2-4 Lowering my head, I think of home.>>JingYeSi.txt

ECHO 3-1 Before the bed the bright moon shines, 3-2 I think frost on the ground it is, 3-3 Raising my head, I watch the bright moon, 3-4 Lowering my head, I think of home.>>JingYeSi.txt

for /f %%i in (JingYeSi.txt) do echo %%i

pause>nul

echo.

ECHO If I only want the sentence "Before the bed the bright moon shines", I need the help of delims:

ECHO for /f "delims=，" %%i in (JingYeSi.txt) do echo %%i 

for /f "delims=，" %%i in (JingYeSi.txt) do echo %%i 

ECHO delims= followed by a comma means using the comma in the original text as the delimiter (the method of division) to divide the ancient poem into four sections. By default, delims only displays the first section before the delimiter, and the delimiter is usually ignored.

pause>nul

echo.

ECHO To display the verses of other sections, the column extraction command "tokens" is used.

ECHO for /f "tokens=2 delims=，" %%i in (JingYeSi.txt) do echo %%i 

for /f "tokens=2 delims=，" %%i in (JingYeSi.txt) do echo %%i

ECHO tokens=2 means the second character set of the object (here, each line)

pause>nul

Last edited by dosz on 2009-3-7 at 10:51 ]

tokens= When the item is empty, only take the first item,
delims= When the item is empty (default), use spaces and as delimiters,

Very good, very powerful, I've learned

I've always been unfamiliar with for, but now I'm a bit closer to it!
THANK ALL!