| Author | Post |
|---|---|
| killbillvol69 All-Star Member ^Lucy Pinder 18631 Posts 4/08 | Hi this was posted in another thread but probably needs to be here. Drew, can you look into this? (It's happening for me as well.) [Link] |
| Jacco All-Star Member "liable to deprave and corrupt" 2673 Posts 5/04 | |
| Joey Starr Senior Member Still wanking after all these years. 8082 Posts 10/00 | |
| Joey Starr Senior Member Still wanking after all these years. 8082 Posts 10/00 | |
| Joey Starr Senior Member Still wanking after all these years. 8082 Posts 10/00 | |
| Drew Black broken crankshaft 8009 Posts 9/99 | |
| Goldstein All-Star Member "You have sacrificed nothing and no one." 3689 Posts 8/10 | For example, so called "smart quotes" are not being handled and a semi-colon is being inserted in its place instead. So, when I've been copying and posting text, say from The New York Times, I've had to resort to going through the text, deleting "smart quotes" etc., and re-typing these characters in the forum(s) message window, so that these characters will render properly. |
| murdock Member I'm not an actor, but I play one on TV 911 Posts 4/06 | |
| Drew Black broken crankshaft 8009 Posts 9/99 | |
| Drew Black broken crankshaft 8009 Posts 9/99 | |
| murdock Member I'm not an actor, but I play one on TV 911 Posts 4/06 | |
| Goldstein All-Star Member "You have sacrificed nothing and no one." 3689 Posts 8/10 | (1) smart quotes were dropped altogether (although the forum has stopped inserting semi-colons for smart quote characters) (2) ";en dash"; was dropped altogether (no substitutes inserted, just dropped) I will type an ";en dash"; example here: First, using two dashes -- instead of an ";en dash"; -- as a baseline. Now, using an ";en dash"; where the two dashes were used as a comparison. And now, using an ";em dash"; which is a slightly wider dash than an ";en dash"; to how this symbol renders. After typing the comparison ";Bakhtiar"; sentences below, it would seem that The New York Times is using the wider ";em dash"; (not the ";en dash"; I originally suspected). --------------------------------------------------------------------------------------------------------------------------------------------- Here is a sentence with the original formatting: Once they got my H.R. statement, I was finished, finished 10 years in the business, Ms. Bakhtiar said. And, here is the exact same sentence with my making character corrections by hand (so we can see what characters are affected): ";Once they got my H.R. statement, I was finished, finished -- 10 years in the business,"; Ms. Bakhtiar said. ####################################################################### ^^^ OK, as we can see, editing a post totally fucks-up the characters! ^^^ Here is the original post above -- copied before editing this post -- and pasted here: In a post Sunday AM, I found that: (1) smart quotes were dropped altogether (although the forum has stopped inserting semi-colons for smart quote characters) (2) "en dash" was dropped altogether (no substitutes inserted, just dropped) I will type an "en dash" example here: First, using two dashes -- instead of an "en dash" -- as a baseline. Now, using an "en dash" where the two dashes were used as a comparison. And now, using an "em dash" which is a slightly wider dash than an "en dash" to how this symbol renders. After typing the comparison "Bakhtiar" sentences below, it would seem that The New York Times is using the wider "em dash" (not the "en dash" I originally suspected). --------------------------------------------------------------------------------------------------------------------------------------------- Here is a sentence with the original formatting: Once they got my H.R. statement, I was finished, finished 10 years in the business, Ms. Bakhtiar said. And, here is the exact same sentence with my making character corrections by hand (so we can see what characters are affected): "Once they got my H.R. statement, I was finished, finished -- 10 years in the business," Ms. Bakhtiar said. ####################################################################### Here is a screencap of my original post here -- before editing the post fucks it up -- just in case: ![]() Obviously, I will now be unable to edit this post further, as everything I've typed here will become gobbledygook Edited by - Goldstein on 7/24/2016 11:47:21 AM |
| Goldstein All-Star Member "You have sacrificed nothing and no one." 3689 Posts 8/10 | As of Sunday, 7/24/16 at 11:51 EDT (1) ALL "smart quote" characters disappear (2) ALL "en dash" disappear (3) ALL "em dash" disappear (4) Semi-colons get inserted for many of these characters when the above post was edited |
| Goldstein All-Star Member "You have sacrificed nothing and no one." 3689 Posts 8/10 | Notice the semi-colons added here (which I noticed as I was being quoted). |
| killbillvol69 All-Star Member ^Lucy Pinder 18631 Posts 4/08 | |
| killbillvol69 All-Star Member ^Lucy Pinder 18631 Posts 4/08 | |
| Drew Black broken crankshaft 8009 Posts 9/99 | And my goal in this is to strip/replace any non US-ASCII characters or strip them to nothing. Unicode and alternate character sets aren't supported. The only reason they were ever supported is because a chunk of code that's about 12 years old never as is should. |
| lex von v Senior Member 2511 Posts 12/12 | @Goldstein: What you call smart quotes are the typographically correct quotes. Some algorithm called smart quotes used by some program converts the typographical quotes (") into the (66, 99)-quotes as needed. So entering a " after a space yields the '66'-quotes, while a " after a character (or a ' after a character) yields the '99'-looking quote (or the '9'-looking character). This means Typewriter Quotes => Transform through Smart quote => Typographical Quotes (66 - 99) When you paste an article from the NYT, you are already pasting the typographical quotes, because there's no character for a Smart Quote. Just out of curiosity: How can unicode characters be used for some database shenanigans or XSS? About the anti-injection stuff (probably the reason for the semicolon handling at the first place): wouldn't something like mysql_real_escape_string suffice, basically escaping quotes and backslashes the correct way before entering them into the DB? |
| Goldstein All-Star Member "You have sacrificed nothing and no one." 3689 Posts 8/10 | I use the term Smart Quotes, to casually refer to the whole group of characters commonly referred to as "smart quotes." Seemingly, this even includes apostrophes |
| killbillvol69 All-Star Member ^Lucy Pinder 18631 Posts 4/08 | |
| Drew Black broken crankshaft 8009 Posts 9/99 | |
| Drew Black broken crankshaft 8009 Posts 9/99 |
| Use the code below to link to this topic or a specific post. |
| URL of this thread |
| Link to this post with HTML |
| Link to this post with Forum Code |