Comment moderation

This commit is contained in:
http://joeyh.name/ 2012-07-26 17:21:26 +00:00 committed by admin
parent efadf5215a
commit 8c3491f50c
33 changed files with 461 additions and 0 deletions

View file

@ -0,0 +1,37 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 4"
date="2012-07-04T13:17:05Z"
content="""
In relation to the system limits,
laplace:~ jtang$ sysctl kern.maxfilesperproc
kern.maxfilesperproc: 10240
Also, the maxfiles for the whole system is
laplace:~ jtang$ sysctl kern.maxfiles
kern.maxfiles: 12288
the above was the defaults as far as I recall. What you probably would be interested is the ulimits that the user see
laplace:~ jtang$ ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) unlimited
max memory size (kbytes, -m) unlimited
open files (-n) 256
pipe size (512 bytes, -p) 1
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 709
virtual memory (kbytes, -v) unlimited
I would imagine the limit that you are looking for is 256. Hope this helps.
----
On the point about deletions not being propagated, it does do a commit. I suspect that the kqueue code is just not picking up the changes and pushing the changes out. The watch command on a single annex with no remotes functions as expected.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 2"
date="2012-06-25T22:36:39Z"
content="""
On the system limits side, I think if you want to make it more approachable by more users then adjusting system limits might scare users away. On the note of the ssh-agents spawning like no tomorrow on my machine, it turned out that i had a symlink from my .bashrc to .bash_profile, I guess I should not be too lazy and have two seperate files.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="jtang"
ip="79.97.135.214"
subject="comment 3"
date="2012-07-26T17:11:55Z"
content="""
It fails on repos with either no files or smaller repos.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 2"
date="2012-07-20T19:31:11Z"
content="""
Glad that I can help ;) Alas if it weren't for the learning curve of haskell, I'd fix it myself.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 1"
date="2012-06-19T06:53:26Z"
content="""
heh, yea, it's detecting changes on OSX ;)
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 1"
date="2012-06-19T07:01:26Z"
content="""
issues with the watch command on OSX, it seems that there is a race condition somewhere. I dumped a few iso's into an annex and it only annexed the smaller files (checksums) and the bigger ones (the iso's) just got made read only. also do you want these bugs to be logged here or in the bugs section?
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo"
nickname="Justin"
subject="comment 1"
date="2012-06-27T12:46:31Z"
content="""
can X and Y be the names of the git-annex remotes?
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 2"
date="2012-07-19T18:43:30Z"
content="""
Joey, yes dbus is available from macports and homebrew, it's not installed by default (or as a dependancy) for most packages in macports.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawn7Oyqusvn0oONFtVhCx5gRAcvPjyRMcBI"
nickname="Michaël"
subject="is ftp an option?"
date="2012-05-30T10:44:12Z"
content="""
for people only having ftp-access to there storage.
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://www.klomp.eu/"
ip="95.91.241.82"
subject="Watch also possible with git?"
date="2012-06-15T17:25:30Z"
content="""
Hi,
it seems that you put a lot of efforts in handling race conditions. Thats great. I wonder if the watch can also be used with git (i.e. changes are commited into git and not as annex)? I know that other projects follow this idea but why using different tools if the git-annex assistant could handle both...
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://wiggy.net/"
nickname="Wichert"
subject="macports"
date="2012-06-12T13:00:34Z"
content="""
The average OSX user has a) no idea what macports is, and b) will not be able to install it. Anything that requires a user to do anything with a commandline (or really anything other than using a GUI installer) is effectively a dealbreaker. For our use cases OSX is definitely a requirement, but it must only use standard OSX installation methods in order to be usable. Being in the appstore would be ideal, but standard dmg/pkg installers are still common enough that they are also acceptable.
FWIW this is the same reason many git GUIs were not usable for our OSX users: they required separate installation of the git commandline tools.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 5"
date="2012-06-17T21:42:59Z"
content="""
okay, I've gotten gitbuilder to poll the git repo every minute for changes, gitbuilder doesn't build every commit. It doesn't work like that, it checks out the master and builds that. If there is a failure it automatically bisects to find out where the problem first got introduced. Hope the change to the builder helps!
"""]]

View file

@ -0,0 +1,9 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawnV2c63kDc6X21a1H81me1mIenUCScd2Gs"
nickname="Emanuele"
subject="watch branch?"
date="2012-06-01T19:19:17Z"
content="""
Hello there? Where can I find more info about this git watch branch?
Keep up the good work!
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawnBl7cA6wLDxVNUyLIHvAyCkf8ir3alYpk"
nickname="Tyson"
subject="Bridging LANs"
date="2012-07-10T10:20:59Z"
content="""
Why rely on the cloud when you can instead use XMPP and jingle to perform NAT traversal for you? AFAIKT, it also means that traffic won't leave your router if the two endpoints are behind the same router.
"""]]

View file

@ -0,0 +1,80 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 1"
date="2012-07-03T08:26:43Z"
content="""
On \"git syncing\" point number 9, on OSX you could potentially do this on a semi-regular basis
<pre>
system_profiler SPNetworkVolumeDataType
Volumes:
net:
Type: autofs
Mount Point: /net
Mounted From: map -hosts
Automounted: Yes
home:
Type: autofs
Mount Point: /home
Mounted From: map auto_home
Automounted: Yes
</pre>
and
<pre>
x00:~ jtang$ system_profiler SPUSBDataType
USB:
USB High-Speed Bus:
Host Controller Location: Built-in USB
Host Controller Driver: AppleUSBEHCI
PCI Device ID: 0x0aa9
PCI Revision ID: 0x00b1
PCI Vendor ID: 0x10de
Bus Number: 0x26
Hub:
Product ID: 0x2504
Vendor ID: 0x0424 (SMSC)
Version: 0.01
Speed: Up to 480 Mb/sec
Location ID: 0x26200000 / 3
Current Available (mA): 500
Current Required (mA): 2
USB to ATA/ATAPI Bridge:
Capacity: 750.16 GB (750,156,374,016 bytes)
Removable Media: Yes
Detachable Drive: Yes
BSD Name: disk1
Product ID: 0x2338
Vendor ID: 0x152d (JMicron Technology Corp.)
Version: 1.00
Serial Number: 313541813001
Speed: Up to 480 Mb/sec
Manufacturer: JMicron
Location ID: 0x26240000 / 5
Current Available (mA): 500
Current Required (mA): 2
Partition Map Type: MBR (Master Boot Record)
S.M.A.R.T. status: Not Supported
Volumes:
Porta-Disk:
Capacity: 750.16 GB (750,156,341,760 bytes)
Available: 668.42 GB (668,424,208,384 bytes)
Writable: Yes
File System: ExFAT
....
</pre>
I think its possible to programatically get this information either from the CLI (it dumps out XML output if required) or some development library. There is also DBUS in macports, but I have never had much interaction with it, so I don't know if its good or bad on OSX.
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="yatesa"
ip="171.25.193.21"
subject="Secret URL token"
date="2012-06-19T03:41:16Z"
content="""
> Instruct the user's web browser to open an url that contains a secret token. This guards against other users on the same system.
How will you implement that? Running \"sensible-browser URL\" would be the obvious way, but the secret URL would show up in a well timed ps listing. (And depending on the browser, ps may show the URL the entire time it's running.)
"""]]

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawlYu7QmD7wrbHWkoxuriaA9XcijM-g5vrQ"
nickname="Royal"
subject="comment 2"
date="2012-06-05T17:19:16Z"
content="""
Hi,
I want to replace rsync with aspera-rsync. Whenever there is file transfer between 2 repositories which are in two different hosts, git-annex will use rsync protocol. I am trying to replace that rsync call with aspera-rsync so that transfer can be more faster. Since I am new to Haskell I am finding difficulties to understand the flow of execution. Is there any way I can debug so that I can get the flow?
Thanks
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 2"
date="2012-07-25T06:52:32Z"
content="""
Ah I was looking at the walkthrough on how to fix the issue, I had not thought about looking at the tips section. That tip fixed the issue for me, thanks.
"""]]

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="https://me.yahoo.com/a/IAg3idYGk.joxsJb2WCxl20gig.0.8hS#d5165"
nickname="Kelly"
subject="comment 2"
date="2012-05-10T15:01:15Z"
content="""
I think my comment a couple days ago got caught in the spam filter, so I'm reposting.
What were the ideas to avoid parameterisation? What were the problems of parameterisation, other than just the current hardcoded assumptions?
Speaking of hash insecurity, http://static.usenix.org/events/hotos03/tech/full_papers/henson/henson_html/node8.html says compare-by-hash is a bad idea. As I understand, git doesn't have an option of verifying content matches when the hash matches when adding data to the object store (like zfs's \"dedup=verify\" option, which you can use even when using sha256), because the assumption is that the risk of collision (or at least just the risk of accidental collision) is negligible. Would it be worthwhile to add this option to git-annex?
"""]]

View file

@ -0,0 +1,11 @@
[[!comment format=mdwn
username="https://me.yahoo.com/a/IAg3idYGk.joxsJb2WCxl20gig.0.8hS#d5165"
nickname="Kelly"
subject="comment 2"
date="2012-05-09T01:22:13Z"
content="""
What were the ideas to avoid parameterisation? What were the problems of parameterisation, other than just the current hardcoded assumptions?
Speaking of hash insecurity, http://static.usenix.org/events/hotos03/tech/full_papers/henson/henson_html/node8.html says compare-by-hash is a bad idea. As I understand, git doesn't have an option of verifying content matches when the hash matches when adding data to the object store (like zfs's \"dedup=verify\" option, which you can use even when using sha256), because the assumption is that the risk of collision (or at least just the risk of accidental collision) is negligible. Would it be worthwhile to add this option to git-annex?
"""]]

View file

@ -0,0 +1,18 @@
[[!comment format=mdwn
username="http://christian.amsuess.com/"
nickname="chrysn"
subject="comment 2"
date="2012-05-11T17:40:20Z"
content="""
from my layman's standpoint, i think it would be feasible. i've suggested this previously, but not pushed it too much. quoting from [[my user page|users/chrysn]]:
* **would like git-annex to**: not be required any more as git itself learns to use cow filesystems to avoid abundant disk usage and gets better with sparser checkouts (git-annex might then still be a simpler tool that watches over what can be safely dropped for a sparser checkout)
*concerning hash sizes or parameterized hashes*: the problems with hash sizes could be avoided if instead of putting the objects in the \"normal\" object dir, barefiles would be managed in a similar way as packs are. when a new files gets added, they'd be cow-copied to ``.git/objects/bare/${HA}/${SH}``, and ``.git/objects/bareprefix/${HA}/${SH}`` would contain the \"blob ${SIZE}\0\" prefix that gets concatenated to the object body to form the object itself.
(maybe it'd even be sufficient to *just store the size* in the bareprefix, as all those objects would be blobs, but then again, some flexibility won't hurt.)
if the *pack file format* is flexible enough, the bareprefix files can get packed too. for the adventerous user who modifies bigfiles, the pack file mechanisms should be made aware of their presence, and be able to store deltas between them. the operations for applying those deltas would be difficult to optimize, and could be added at a later stage. a typical example could be storing a pdf file -- the pdf file format is designed for appending, so chances are the new version is just the old version plus several k at the end.
neither of that would affect git's *wire protocol*, so no compatibility problems. (it would be advisable to find a reasonable way to do sparse checkouts, though; something like \"server, pack and send your master, but make it sparse and don't include blobs >1mb\").
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawlYu7QmD7wrbHWkoxuriaA9XcijM-g5vrQ"
nickname="Royal"
subject="Resolving conflict"
date="2012-04-24T03:59:31Z"
content="""
Hi,
Now I am able to resolve the conflict.
Thank you.
"""]]

View file

@ -0,0 +1,41 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawlYu7QmD7wrbHWkoxuriaA9XcijM-g5vrQ"
nickname="Royal"
subject="Resolving conflict"
date="2012-04-23T15:49:30Z"
content="""
Thanks for the reply.
I am executing the following commands.
git init main
cd main
git annex init main
echo a > a
git annex add a
git commit -m Initial
git annex unlock a
echo aa > a
git annex add a
git commit -m first
git annex unlock a
echo aaa > a
git annex add a
git commit -m second
git log
git cherry-pick <Hash of first commit>
--------------------
Error:
error: could not apply 2be8f38... first
hint: after resolving the conflicts, mark the corrected paths
hint: with 'git add <paths>' or 'git rm <paths>'
hint: and commit the result with 'git commit'
How can resolve the the above conflict.
If I see the content of the file I will get the content of second commit.
Is there any way I can get the content for first commit(Like in git we have 'theirs' option.)
Thank you.
"""]]

View file

@ -0,0 +1,18 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo"
nickname="Justin"
subject="comment 2"
date="2012-06-27T12:45:42Z"
content="""
I have a hacked up version of sharebox that does this.. I need to fix it up and push it to github..
the short of it is that you can do
def calculate_size(path):
annexfile = os.path.basename(os.readlink(path))
#SHA256-s2007550713--....
size = annexfile.split(\"-\")[1]
return int(size[1:])
to get the size of files.. a 'git-annex du' should be pretty straightforward...
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 1"
date="2012-06-23T08:00:12Z"
content="""
actually, scratch that, i found it. it was in _.git/annex/daemon.log_ along with the other bits and pieces
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 2"
date="2012-07-03T14:48:16Z"
content="""
Adding a date and timestamp would be a nice start to improving things.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 1"
date="2012-07-02T16:25:55Z"
content="""
I've some binaries for OSX which can be found at <http://www.sgenomics.org/~jtang/gitbuilder-git-annex-x00-x86_64-apple-darwin10.8.0-binary/dist/> its just the master branch, and it's built on a system that runs macports. Binaries are built and updated whenever there are changes made to the master branch of git-annex.
"""]]

View file

@ -0,0 +1,16 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmLB39PC89rfGaA8SwrsnB6tbumezj-aC0"
nickname="Tobias"
subject="Thats a fair solution"
date="2012-07-22T13:51:25Z"
content="""
Until you don't have(access to) an existing repository to clone from.
I really hope you revisit this when you come to the encryption part of the assistant.
Btw, I also run FreeBSD if you need a tester on that at some point.
Sincerely
Tobias Ussing
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="hannes"
ip="130.226.142.243"
subject="original repo git annex version"
date="2012-07-08T11:55:42Z"
content="""
is 3.20120629
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus"
nickname="Jimmy"
subject="comment 17"
date="2012-07-24T06:33:13Z"
content="""
@a-or-b that issue is logged here [[bugs/subtle build issue on OSX 10.7 and Haskell Platform (if you have the 32bit version installed)]], you can use cabal to build and install git-annex and it will detect if its 32 or 64bit automatically.
"""]]

View file

@ -0,0 +1,19 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmURXBzaYE1gmVc-X9eLAyDat_6rHPl670"
nickname="Bram"
subject="Build failure using Cabal"
date="2012-06-24T19:46:13Z"
content="""
Unfortunately I get a build failure when building this version using Cabal:
[113 of 183] Compiling Assistant.Changes ( Assistant/Changes.hs, dist/build/git-annex/git-annex-tmp/Assistant/Changes.o )
Assistant/Changes.hs:73:30:
Not in scope: `tryReadTChan'
Perhaps you meant `readTChan' (imported from Control.Concurrent.STM)
cabal: Error: some packages failed to install:
git-annex-3.20120624 failed during the building phase. The exception was:
ExitFailure 1
The complete build log is at <http://paste.debian.net/176125/>. I'm looking forward to trying out the new watch behaviour!
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="https://me.yahoo.com/a/2djv2EYwk43rfJIAQXjYt_vfuOU-#a11a6"
nickname="Olivier R"
subject="It doesn't work 100%"
date="2012-05-03T21:42:54Z"
content="""
When you remove tracked files... it doesn't show the new status. it's like if the file was ignored.
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="https://rmunn.myopenid.com/"
nickname="rmunn"
subject="comment 1"
date="2012-06-12T15:52:35Z"
content="""
* One way to handle the configuration might be with regular expressions. If the URL matches regex A, handle it with downloader A' (with option set A''). If the URL matches regex B, handle it with downloader B' and option set B''. And so on. Then if nothing is matched, the default downloader is wget/curl.
* In my experience, youtube-dl breakages are fixed relatively quickly; a much more serious problem from a trust standpoint is that Youtube videos often disappear. Sometimes due to a legitimate copyright claim, sometimes due to illegitimate copyright claims. (I've seen both happen). Or because the video uploader decided to upload *other* videos that violated copyright, and Youtube closed his/her account, thereby removing *all* his/her videos from the Web. Youtube is definitely an untrustworthy repository as far as \"the file will still be there later on\" is concerned. Perhaps a default trust relationship could go along with the regexes? URLs matching regex A are semitrusted, while URLs matching regex B are untrusted.
"""]]