Add a line if it's missing
I have a data gathering device which records per second. Sometimes, randomly it drops a second or more. For example
166,1.09424,240,76,132
168,1.10088,215,76,132
169,1.10765,213,78,131
170,1.11458,198,79,131
It can gather 1M data points in a session, and might miss >100
Looking around I found this AWK command
awk '{ while (NR + shift < $1) { print (NR + shift) " NA"; shift++ }; print } END { shift++; while (NR + shift < 13) { print (NR + shift) " NA"; shift++ } }' /tmp/test1
from this answer
but that gives new lines when they aren't needed:
166 NA
167 NA
168 NA
169 NA
170 NA
What am I doing wrong?
shell-script osx
New contributor
add a comment |
I have a data gathering device which records per second. Sometimes, randomly it drops a second or more. For example
166,1.09424,240,76,132
168,1.10088,215,76,132
169,1.10765,213,78,131
170,1.11458,198,79,131
It can gather 1M data points in a session, and might miss >100
Looking around I found this AWK command
awk '{ while (NR + shift < $1) { print (NR + shift) " NA"; shift++ }; print } END { shift++; while (NR + shift < 13) { print (NR + shift) " NA"; shift++ } }' /tmp/test1
from this answer
but that gives new lines when they aren't needed:
166 NA
167 NA
168 NA
169 NA
170 NA
What am I doing wrong?
shell-script osx
New contributor
2
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago
add a comment |
I have a data gathering device which records per second. Sometimes, randomly it drops a second or more. For example
166,1.09424,240,76,132
168,1.10088,215,76,132
169,1.10765,213,78,131
170,1.11458,198,79,131
It can gather 1M data points in a session, and might miss >100
Looking around I found this AWK command
awk '{ while (NR + shift < $1) { print (NR + shift) " NA"; shift++ }; print } END { shift++; while (NR + shift < 13) { print (NR + shift) " NA"; shift++ } }' /tmp/test1
from this answer
but that gives new lines when they aren't needed:
166 NA
167 NA
168 NA
169 NA
170 NA
What am I doing wrong?
shell-script osx
New contributor
I have a data gathering device which records per second. Sometimes, randomly it drops a second or more. For example
166,1.09424,240,76,132
168,1.10088,215,76,132
169,1.10765,213,78,131
170,1.11458,198,79,131
It can gather 1M data points in a session, and might miss >100
Looking around I found this AWK command
awk '{ while (NR + shift < $1) { print (NR + shift) " NA"; shift++ }; print } END { shift++; while (NR + shift < 13) { print (NR + shift) " NA"; shift++ } }' /tmp/test1
from this answer
but that gives new lines when they aren't needed:
166 NA
167 NA
168 NA
169 NA
170 NA
What am I doing wrong?
shell-script osx
shell-script osx
New contributor
New contributor
edited 3 mins ago
tink
4,47711221
4,47711221
New contributor
asked 26 mins ago
Steve ShinySteve Shiny
1
1
New contributor
New contributor
2
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago
add a comment |
2
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago
2
2
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "106"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Steve Shiny is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f500969%2fadd-a-line-if-its-missing%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Steve Shiny is a new contributor. Be nice, and check out our Code of Conduct.
Steve Shiny is a new contributor. Be nice, and check out our Code of Conduct.
Steve Shiny is a new contributor. Be nice, and check out our Code of Conduct.
Steve Shiny is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f500969%2fadd-a-line-if-its-missing%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
You don't appear to be taking account of the delimiter (comma versus whitespace)
– steeldriver
22 mins ago